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SUMMARY 


Thl« two port volume reports on the second end third phenes of 
the hASA reeearch contract NAS8-31373 Initiated March 1975 and 
culminating in December 1978. 

The three phases of this contract are identified by three work 
statements : 

Phase I; Work Statement I dated March 1975 

Phase II: Work Statement II dated December 1976 

Phase III: Work Statement III dated November 1977. 

Work Statement I dealt with the generation of Holographic fil- 
ters by digital techniques and the work of this phase was reported 
in final form through the interim final report dated August 1976 
(Mississippi State University Report MSSU-EIRS-EE-77-1) . 

Work Statement II deals with digital data communication over RF 
channels with both random and bursty error characteristics, i.e. a 
compound channel. Volume I of the final report dated December 1978 
reports on this phase of the contract. In particular a Hybrid de- 
coder was developed and proven by simulation to be superior to a 

Viterbi decoder. 

Work Statement III deals with a survey of projected coding 
technology developments in the 1980-1985 time frame. Volume II of 
the final report dated December 1978 reports on this phase of the 


contract. 



ABSTRACT 


The main purpose of this research is to develop an algorithm 
whose performance approaches that of the optimal maximum likelihood 
Viterbi decoder in dealing with random errors and yet possesses a 
burst-error-correcting capability close to that of the optimal B2 
decoders. The algorithm developed uses a syndrome detecting logic 
to direct two decoders, namely, the Viterbi decoder and the algebraic 
decoder, to assume the decoding load alternatively, depending on the 
channel characteristics at the moment. 

The algebraic decoder used in the hybrid algorithm is an opti- 
mal B2 burst corrector suitable for the decoding of nonsystematlc 
convolutional codes. The algebraic decoder is capable of correcting 
any short burst as long as the total number does not exhaust the 
storage capacity of the decoder. It can also correct long bursts 
equal to or less than (constraint length -1) blocks with high prob- 
ability without having to sacrifice the random-error-correcting 
capability of the codes. When encountering long bursts which are 
beyond the error correcting capability of the algebraic decoder, the 
overall system will outperform the Viterbi decoder because error 
propagations are suppressed. 

The hybrid system works extremely well for compound channels 
with periodic bursty interferences; however, for random bursty 
channels in which the required clean guard spaces are not present, 
the performance of the hybrid system may on occasion become worse 
than that of the Viterbi decoder. 


An ewltlol >tudy of the performance of the Vlterhl 
in huraty channela »a. carried not and an Improved algebra 
tor nonayatematlc codea .as developed. The hybrid algorithm .as 

Having various error statistics, ranging from pure random error to 
pure bursty channels. The hybrid system outperformed both the 
algebraic and the Vlterhl decoders In every case, except the IT 
random error channel .here the vlterhl decoder had one bit le.e 


decoding error. 
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CHAPTER I 


INTRODUCTION 

1.1 Information Tranamlaalon 

Communication is a process by which messages are transferred 
from one point to another. A message is assumed to be an ordered 
selection from a known set of symbols. Furthermore, conmunicatlon Is 
a random process; otherwise there would be no need to communicate. 

Let X be a random variable idiose sample space consists of the m source 
symbols; x^, ... x^}. At the destination, one of the desti- 
nation symbols of the ensemble {y^, y^, ... y^^) will be identified by 
the signal transmitted. The destination can be represented by a 
random variable Y. A signal is a physical realization of the message 
so that transmission through the media, or channel, is possible. 

This conversion Is done by the transmitter. The function of the 
receiver Is to guess the source symbol sent based upon the received 
symbol y^ and its a posteriori probability P[x^|yj] for 1 - 1, 2, 

^ optimal decision rule is that is determined as 

the source symbol sent if Plx^ly^J > P[x^|y^J for all i ,« k. 

The assuiq>tion that the messages to be sent are chosen from a 
finite set may not be as restrictive as it seems to be. (1) The 
difference between very large and infinite becomes very small when 
dealing with practical systems. For instance, our language uses 
discrete synbols but it can be used to express nondiscrete feelings 
and emotions to a fair degree of accuracy. (2) There is no real 


f 


e 


/ 


conmunlcatlon channel which can convey slgnaiLs t<9 ^ arbitrary degree 
♦ 


of accuracy; Ig^ever, the quantization error caused by converting 


the continuous sample space into discrete sample space can always be 


made less than the channel errors if the quantization level is fine 


enough . • 

fk order to make a quantitative analysis of communication sys* 
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terns we may define the information content of a message as the "uncer* 
talnty" of that message. The more likely the occurrence of a wet 


the less information it carries. Therefore the ia'formation content 

* 


of a message is defined as 




- log P(x^) 


which is also called the selt-infonnation of X • . The average 


self-information over ail source symbols is called the entropy of 
the source, a term borrowed from statistical thermodvnBmlcs and used 
in the same sense. • 


Similarly the information provided about the event X ■ x^ by 


the occurrence of the event Y ■ y may be defined as the mutual 
# J 


information of the Joint event X ■ x^ and Y “ y^ . This is a 


measure of how much the occurrence of a particular alternative, say 


y^ • in the Y ensemble tells us about the possibility of some alterna- 


tive, say x^ , in the X ensemble. Mutual information is denoted as 




log 


m. 




Px(J‘i) 


*Log X is base 2, not base 10. 


O 


0(1 


o 


o 


o 

O 
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The average mutual information over all Input and output symbols Is 
denoted as 


I(X;Y) 


I«1 J«1 




As shovm earlier in discussing the optimal receiver decision 
rule, the effect of the transmission is to alter the probability of 
each possible input from its a priori, i.e. P(x^), to its a posteri- 
ori value, i.e. P[x^|yj] . The more the channel can improve the 
a priori probability, the more capable the channel. If the channel is 
noiseless, after transmission the a posteriori probabilities of all 
messages would be deterministic. Obviously, maximizing the average 
mutual information of a channel over all possible input assignments 
can serve as a measure of the channel capacity , C. 

Although I(X;Y) is a function of both the channel and the input 
assignment, C is a function of only the channel. As a matter of fact, 
for a symmetric, discrete memory less channel — i.e., where the occur- 
rence of each output symbol depends only on the corresponding input 
symbol and does not depend on inputs and/or outputs in the past, and 
the transition probabilities P(yj|x^) of the channel are symmetric— 
the maximum occurs when the input symbols are equally probable. There- 
fore just as entropy is a measure of the source demand, channel 
capacity can be Interpreted as the ability of the channel to handle 
the demand. 

If the channel is noiseless, the channel capacity will always be 
equal to the source entropy, even when the source rate reaches to in- 
finity. If this were true, there would be no problems of communica- 
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tlons. n.tur. u „„t b.ne™i.„t, >o«e .re 

bound to occur. Ihl, the Infonuitlon h«,dll„g capability 1 . 

United for «,y physlcl ch«mel, e«„ the source «ssege. ere picked 
Iron a finite set, l.e. each symbol carries only a finite amount of 
Informstlon. The first resolution Is to break the source symbols 
into smaller units so that each ne. symbol ulll carry less Information. 
n>is Is called source encoding. As mentioned earlier the most effic- 
ient use of the channel Is to make the a priori probabilities of the 
source symbols equal, ais can be taken care of during source en- 
coding by using longer sequences to encode the leas probd.le messages. 
H.e message symbols may be broken down to any le™l necessary with 
the aamlleat possible le«l being „„e bit, l.e. messages may be 
encoded using only two symbols. "O" and "I". The level to which 
message sy,*ola should be broken depends on the channel quality, or 
the a posteriori probabilities, or the channel capacity. If the chan- 
nel algnal to noise ratio Is so strong that It allows the transmission 
of 4 symbol, without a wrong Interpretation at the receiving end. then 
4 symbols may be used to encode the message symbols. If the 4 syatols 
ere equally probable, then each symbol will carry I . -log i - log 4 
- 2 bits of lofomatlon. Therefore, the channel capacity Is fully 
used and reliable communication la schleved. However. If the ch«,nel 
cannot distinguish 4 levels of signal yet 4 symbols are used to en- 
code the message symbols, reliable communication cannot be achieved. 

Up to this point It is clesr that as long as the channel Is not over 
used, reliable communication Is Indeed achievable. This la the basis 
of Shannon’s [1948)1 noiay-channel coding theorem. 
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In practical conaunl cation ayatana« an attampt la »ada to sand 
algnala at auch low powar lavala that avan whan tha baat algnallng 
method, auch aa antipodal algnallng, la uaad, tha racalvar may atill 
make mistakaa. Thia meana tha channel capacity par unit time la 
below 1 bit par unit time. Tharafora, avan If tha maaaaga ayobola 
are broken Into tha lowest poaaibla unit, l.a. blta, maaaagaa still 
may not be transmitted with confidence. Fortunately, Shannon’s 
theorem does not say that measagas cai\not be transmitted at a rata 
lower than I blt/unlt time. To make tha Information content of each 
bit lass than 1 bit, redui^dant bits which do not carry Informatloit 
have to be added or one bit of Information has to be distributed to 
several bits. Has la where coding theory comes into play. This 
second encoding before transmission is called channel encoding to 
distinguish it from the process called source encoding. Since It is 
easier to develop codes for binary coding, normally source symbols are 
encoded into binary digits first and then channel encoded; however, 
thia is not generally necessary. Aa a matter of fact, some q-ary BiM 
(Boae~Chaudhurl~HocquengheiiO codes, auch aa the Reed”l*olomon code, 
have already been developed. Altlu'ugh the vast majority of the orror~ 
correcting codes have been designed for additive noise, one-way, 
memory less, symmetric channels having orthogonal input signals, work 
has been done for other types of channels, for Instance, channels with 
memory, channels with nonorthogonal input algnala, and asymmetric 
channels. For practical applications, channels with memt^ry deserve 


mu.o more attention and even nwve so In the future. 
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1.2 Compound Channels 

During the discussion of the communication theory, the situation 
was over simplified by use of a discrete memoryless channel as the 
model. Although in nature there are channels which can be effective- 
ly modeled as additive white Gaussian noise channels (AWOO , for 
instance the apace channels, the vast majority of the real channels 
do have some degree of memory, i.e. each symbol in the output sequence 
depends statistically both on the corresponding input and on past in- 
puts and outputs. A physical channel of this nature is a channel 
whose noises cluster into bursts , i.e. it will have numerous errors 
in a short time span and be extremely clean at another time. We call 
the noisy periods the bursts and the clean periods the guard space. 

A strictly bursty channel, like a random error channel, is a highly 
idealized model; therefore, the so called compound cl^^ channel 
with both random errors and bursts— becomes a much more realistic 
model for most physical communication channels. Unfortunately, due 
to the complexity of its mathematical analysis, few results have been 
achieved in this area. The existing coding schemes for compound 
channels lean either to one side or the other or are severely limited 
to some special situations. Tliis problem is the major concern of the 
rest of the work. 

The reason we regard noise as the only factor which gives a chan- 
nel memory is that the dependence of message symbols is removed after 
source encoding. In fact, message symbols are highly dependent in 
most practical situations, for instance, the probability of an 
English letter is statistically dependent on the occurrence of the 


r 


pr*c«dlii« ••Qt«nc«« .... How«v«r * 

* • Po»«ibl« to Mp any 

.« «.<• «oth.r .« ., 

."2 ‘-« P«.^.U.i.. o, .H... ^ • 

"-P«d«.. ,K. ewi c„ b. ««„».. „ .b. bl„„, 

ch«nn«l (BSC) . R**»on* for br««kint Maaimo - ..k 

«r.aKing Maaaga «yn^ola to thla funda- 

M»tal Xavol ara two-foldi (1) a_-^ 

channala parfona voraa than 
binary channala in fldalltv u .. 

n«ut,. .Ithougb tb.y c« tr«,..u d«. („„t 

*"*“°*> ,t . blgh.r r.t.i (2) for ,.„ „, , 

V4i tor aaaa of analyala and 

«PP Icatlona of arror-corractlna codaa 

* *r^ coaplicatad 

to Inplanant. 

At thla point a block dlaaraa ».x» 

* any b« v'onatructad to auanarlaa 

tha dlacuaalon ao far (Plguro 1.1). 
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Channel 
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iStannalj 
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b'lg. 1.1 Block dtagraa of c 


laimun teat ion ayataw. 


.«..*1. «, b. caua , .ooro. .,„b*„ ,„J ,.ro ^ 

^•ttar. 11, a naat .tap t. to aoorca aucoda thaaa lattara into binary 
-...f .boo . 
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sending to the transmitter. The transmitter converts the binary 
stream Into suitable form for transmission over the physical channel; 
this Involves various signaling and digital modulation schemes. At 
the receiving end the reverse procedure la applied; first, the 
received waveforms are demodulated, then "channel decoded" to remove 
errors, "source decoded" to convert the binary stream Into source 
letters and finally the received messages are dunked to data sink, or 
the user. If analog messages are desired, a dlgltal-to-analog con- 
verter may be used. The quantization error can be made as as 

desired by decreasing the step size of the quantization level. 
Normally, the trade-off depends upon cost consideration and the user's 
needs. This Is true for all other designing factors of a communica- 
tion system, especially the application of error-correcting codes. 

1.3 Historical Background of Coding Theory 

Strictly speaking, coding theory has Its own origin and was not 
Initiated by Shannon. Prior to the publication of Shannon's coding 
theorem, Hamming had already developed the (7,4) code; as a matter of 
fact. It was used In the 1948 paper of Shannon^ as an example. 

Shortly thereafter, Golay^ published his (23,12) code as well as the 
rather straightforward generalization of Hamming's (7,4) code to all 
of the other Hamming codes. Even though both were concerned with the 
problem of reliable communication over noisy channels, the coidiinat- 
orlal, constructive, deterministic viewpoints of Hamming and the 
probabilistic, statistical, existential viewpoints of Shannon were 
quite different. However, Shannon's paper certainly added new 
vitality and insight into the development of coding theory. Only 
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Hvm y.™ Uter, BUM IU551> lnv«t«l conyolutlonrt codM. 
obvloMl, iMplMd by ShmnM-. codln, th.or«. Sloe. thM. codlo, 
th.ory hM d.Mlop.d lo wo dtff.wnt dlt.ctloo.--th. .lg.brUc Md 
th. probMllUttc .chooU-md th. codM th.y d.«lop.d .c. c.ll.d 
.IpphrUc codM (block cod..) Md cooyolutloo.1 cod... 

■m. .xiatooc. of .lg.br.tc cod.. hM It. 0.0 tight! th... cod.. 

.t. highly .ttoctotadi th.lt dacodlog. .t. d.t.mlol.tlci th.y cm b. 
M.ly..d Mlog .b.tt.ct rn.th.MtlM. M ..tly m th. SO*. MuUot 
1195A]', B..d tU54l‘ Md SlaplM [M56)‘ lodlc.tad that . Utg. 
body of koo»l.dg. Moot flolt. Mth.Mtlc.1 .ttuctot.., 1... flolt. 
tlog.. fl.ld. Md «lg.btM, could b. btought to boot 00 th. coding 
ptoblM. SOOO .ftot, PtM*. IMSir ptopoMd th. bloaty cycUc cod., 
vhlch w.t. g.n.t.t.d by th. ptlmltlw polyooiU.U ovat th. CUol. 
fiald of 2 oyMoU. Th. big broMthtough io th. d.«lop-ot of 
.IgobtUc cod.. .M th. advaot of th. BC* cod.. (Boc,u.ogh.. 1»591«. 
Be Md Chaudhutl IWSOl’-''). th. BS (R..d-Solo«m 119601") codM 
Md the oo.blo.ty BCH (Oot.o.t .10 Md Zl.tl.t 119611") cod... .hlch 
at. .11 g.o.r.t.d by ololou. polyoo.1.1. of .l.-ot. fto. th. O.I 0 I. 
fUld 0P(2"). Th. d.codlog algotlth. of BOt cod.. »« flMt ptopM.d 
by P.t.t .00 |1960l'». Md th.o g.o.t.lU.d Md t.flo.d by Got.o.t.lo 
Md TUtlot, Chl.o, B.tl.kMp. Foro.y Md MM..y. Th. d.codlng of 
BCH cod.. .1.0 tocult.. co.put.tloM which m. O.lol. fl.ld .tlthM- 
tlc. BOI cod... 10 fact. at. . .ubclM. of th. cyclic cod., which. In 
tutu .t. . .UbclM. of th. g.o.t.l llo..t block cod... B..ld.. 


flolt. algobt... flolt. g.0Mtrl.. w.t. .1.0 MPU.d to th. coding 
ptoblM. OooMtty cod., wot. flMt .tudl.d by Rudolph 11966)'* .od 
Ut.t ..coded Md g.o.t.ll..d by Moy othot coding loVMtlg.tot.. 
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Both "flniu proj«ctlv« g«o*»*try*' «nd ”BucUde«n g*o««try” w«r« 

•ppllod in th» conatructton of th*a« codaa. Tho dovolopownt of g«on«> 
try codoa w«a motlvatad by a apacial dacoding nathod for a aubclaaa of 
tha block codea, including aosta of tha BOi codaa, callad majority 
logic dacoding. Majority logic dacodabla codaa ara orthogonaliaabla 
codaa. Soma of tha axanplaa ara tha (13,7) 8CH coda, maxiauar length 
codea. dlffaranca-aet codea. the (2*, 2* - a - 1) Hamming coda, tha 
(2*" - 1. a + 1) BCH codea, the (31.16) BCH code and tha two typaa of 
geometry codea mentioned above, with the Raad-Mullar codaa, aa tha 
beat known Kuclidean geometry codea. Another lng»ortant decoding 
method for cyclic codea la the modified Meggltt decoder, callad error- 


trapping decoding, which can be applied to almoat any cyclic codea. 


Although thia decoding method enjoys a very alropla coniilnatlonal 


logic circuit, it loses error-correcting capability for long, high- 
rate codea. 

The algebraic codes, though they enjoy beautiful structural 
properties, do not approach an arbitrary small error probability 
for asymptotically Uwg block lengths for rates less than channel 
capacity as promised by Shannon's coding theorem. While tha alge- 
braic codes are asymptotically weak. It was known that the error 
probability of sequential decoders. Invented by Woaencraft and 
Reiffen jlAiblp^ and subsequently refined by Fano 11963]*^ for the 
decoding of convolutional codes, could he made to approach aero 


rapidly as long aa the transmission rate was below the computational 
cutoff rate, which, in general, is a substantial fraction of 

the channel capacity. However, this barrier was further remv>ved by 
the advent of the Vlterbl algorithm (1967|.'^ Both the sequential 
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Lorlth. th. Vlfrbl th. r.c.l„d 

«.t Uk.ly .ourc. ..quenc., 1 ... Uk.Uhooi decoding, »hu. 

th. Utter 1. not bounded b, .nd thu. 1. optlnel in the 

ol Sbennon'e coding tbeoren. since tbe nu.d.er of conp.rl.on. 
required per decoded bit for . Vlterbl decoder Incree... «qu,n.tl.ll, 
rttb con.tr.lnt length k. It 1 . lnpr.ctlc.1 to .tte.pt to .chl.« . 
.«ell probeblllt, of error nerel, b, Increeelng the cnetreUt 
Iwigtb. Therefore, It 1 , Inperetlw to find “good" convolution code,. 
Coetello |197«) defined "good” code. .. code, that heve optlnel 
letence, a tem he Invented to repreaent the entire 

dl.t«.c. between co<h»,ord. fro. the «,coder. a. a re.ult, he found 
that the chance of an optlnal d,^,^ cod. being eytenatlc 1. very 
.11. «.d nearly all tbe no„.y.t.«tlc code, are better cod... Du. to 
the "non-algebralc" nature of their atructuree, convolutional code, 
are extremely difficult to enalytei coneequeotly, very little 1 . 
kno«. about their etructural propertlee. Ihi. 1 . probably the «l„ 
drawback of thl. cl«i. of code.. Traditionally, the conatructlon of 
convolutional code. wa. don. by trial «,d error and ... limr.g 
eyateMtlc code.. For noneyetewtlc cod.., f.r the only known way 
0 find good code, la to make an exhauetlve eaarch of all poealbla 
code., ualng n> educated routine propoaed by Bahl at. el.U 

convolutional code. c«. be truncated into block, of fixed length 
~d then decoded algebraically. Although the randon-error-corractlng 
oapeblllty would be reduced, alg.br.lc decoder, are very attractlv. 
for buret-error-correctlon,. Unfortunately, with the exception of 
the decoder propo.ed by Kob.rt U. Soyd (I976l”. all th. known 
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d.c<KHn, .Xr.rtth« eoj... ^yd'. 

d««l.r ...d tu. ld« „ 

o( corncclns «l>ort bunti of <»• block. Thonforo, It lo M|hly 

doolrobl. to do«lop forthor olpbrolc docodlng .lr>rlth«. for non- 

oyotoutlc convolotlonol codot to htndlo »cb loopor burtto. Tbl, i, 

«>• of the major oftorto of thla dtaaortotlon. Cloarly If ouch an 

aldabralc alporlth. could b. .chla»«l. than with propar lnt.rf.ctn, of 

It .1th tb. vttorbl aUorlthm. a hybrid ayata. could b. davolopod 

»tth a porfonmnic. „ual to that of tha Vlt.tbl d.codar for th. r«.don 

•rror. and aa po..rful aa th. .lg.br.lc decoder Itaelf for borate. 

For lnt.tm.dlat. altuattona, that la. m tha ct«poond ch.nn.la, tha 

hybrid ayatem ahould certainly outperform either of eh. decoder, 
alone. 

1*4 Conclusion 

A heurl.tlc Int.rpcet.tlon of Sh«,non'a codln, theor.. ... 
attempted and a hlaterlcal b.ck,r«und of the codln, deyelopmont ... 
briefly introduced. Thla chapter 1, not intended to ho tutorial but 
only aerv,, to orient th. reader, to th. dt.cuaalon. In th. follo.- 
In, chapter, nod make the dlacuaalona more comproheoalve. 

Codln, for compound chwinel. doe. have It. "Infotmatlon th«.ry" 
foundation. Shannon', nol.y-ch.nn.1 codln, theorem 1. a vary geoaral 
fundamental theorem. It applle. both to memory 1... channel. «,d to 
channel. .1th memory, and can be generallied to nondlacrete channel, 
a. mill. Ibote are al.o code, dewloped for atrlctly buraty channel. 

«ld for compound channel., h<n»,er, moat of the. are block code, and 
the knen convolutional code, for channel, .ith m«„ry are atrlctly 



for bursty chsnnela; therefors, their random error correcting capa- 
bilities are greatly sacrificed. Other techniques such as Inter- 
lacing and concatenation also have their shortcomings. Interlacing 
achieves burst error correction at the price of random error cor- 

while concatenation Involves using two codes, a process which, 
of course. Introduces rate loss. In any case, none of the existing 
coding schemes hat' a performance approaching that of the optimal 
^l^*rbl decoders for random errors and yet behaves as an optimal B2 
bursts corrector when dealing with clustered errors. It Is the purpose 
of this work to attack this goal. As will be shown In the following 
discussions, though there are problems not coiiq)letely solved, some 
very prosilslng results have been produced and a coding scheme which 
outperforms other knotm schemes In a large selection of practical 
conmunlcatlon channels has been accomplished. It Is felt that, at 
least In principle, an optimal decoding algorithm for compound chan- 
nels as defined above Is achievable. Should such a scheme be realized, 
coding applications would not be limited to a few special type of 
channels. Its value and Impact to practical communications could be 
very significant. 




CHAPTER H 


convolutional codes 

2.1 The Codea 

-. .f «.. U„„ <.. ^ ^ 

7 •*’"““•• "•“"* ‘- «»‘ •‘•vPoi... «„v.xu««u 

^P-d. „o. 

r*7 ‘ - ^ ‘ 

length. Taking the second viewDoln^ k 

viewpoint, however, convolutional codea 

•r. not.... „„ ... 

•ft. .«,«„«.! «c..„ ^ 

2.2 ^ ^ ebralc Encoding and Decoding 

Encoding of block codea can moat eaallv b* 

"wc easily be comprehended as a 

■epplng process from a k-dln*n. 4 ^ , 

„ „ ., •'•■=• “ »• •nb.p.c of 

« -7— — . o.„«. , 

« tK. 

•P.C f.o. coa. ...c .. ... 

HuMn. dl.tmce. For bln.iy cod., th. „ 

^ *•• “-*P*“ *• oy.r ef( 2 ) „d 

«>• dl.t«ic b.tM.„ „ ood V d( , 

-• '«.»l . 1. d.fli»d u th. ni^r of 

conponont. lo irtilch thop differ 
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A shorthand notation for linear vector space la tha aatrlx 
notation. We aay let the k basis vectors (each la a n-tupla) ba 
the k rows of a k x n natrix G . called generator matrix. 





f 

*l»l * 1.2 ••• *i.n 

G - 

<82 
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• 
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* 2.1 82.2 ••• i 2 ,n 
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# 

i i 


• • . 
*k.i 8 k ,2 ••• 


Then encoding becomes the postmultiplication of the measage blocks 
(k-tuples) by the generator matrix so that all code vectors are 
linear conbinatlons of the basis vectors that spans the code space. 

It Is known that for any k x n matrix G with rank k . there 
exists a (n-k) x n matrix H with rank (n-k) such that the row 

space of G is the null space of H or vice versa, H is called 
the parity check matrix. 


► 


f 

"1 


1*1.1 ** 1,2 ••• 

"a 

m 

^2 1 ^99 • • • 

2»n 

e 

• 


• • 

• « ^ 

• 


• • 

n-k 


n-k,i n-k . 2 **’ ^n-x.n 

» 4 


‘ i 


Decoding is simply the postmultipllcation of the received code 
word Y by H . since every member in G , i.e. ^ , i, orthogonal 
to every menfcer in H , if the received r is indeed a member of G. 
the product would be zero. i.e. r H - ^ H - 0 . otherwise, the pro- 
duct would be nonzero, i.e. rH-(^+e)H-^H + eH-eHi<0. 


iOEDltdG PAGE BLANK NOT niMED. 
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This nonzero vector is called the eyndrosae vector because it pro- 
vides some information about the error vector e . 

In order to find H , k x (n-k) simultaneous equations, l.e. 

*^1 — J * ® I ■ 1» ...» k, J ■ 1, n-k , have to be solved* 

This involves a trenemdous amount of work for large k and n-k » 
and unfortunately this is exactly how a **good code” should be. How- 
ever* the simplicity of GF(2) arithmetic pro^des an easy way out. 
That is, let G contain an identity matrix: 


G - 


11 


^^21 


12 


>*> • • • 


kl 


k2 


l.n-k 

9 

■2, n-k 


k,n-k 


5 or G - [1^;P] 





j 

then 

we can 

form: 




* 

1 



P P 

1 

» 

* 

k2 ; 


H - 

Pj2 • • • 

f 

* 

k? * 

1 1 



• 

s % 

• • 

1 n-k 

4 

, 



P P r 

l,n-k "^2,n-k ‘ 

% 

1 

k,n-k j 




f 

f i 

By so 

doing, 

it can be easily seen 

tl#l; 


c • - (I : P) • “ 

P 4- P U 


; or H - (P^'u ] 

— n-k 


# 


Code words produced by this type of generator matrix always contain 
their message words explicitly and therefore are called systematic © 


codes. Since the additional constraint of containing an identity 
sub-matrix in the generator matrix inq>oses a severe limitation on the 
freedom of choosing good codes, systematic codes normally do not give 
optimal Hamming distances. Unfortunately, most existing algebraic 
decoding schemes are for this type of codes. 

Physical realization of <rity check codes can be achieved with 
a k-stage shift register connected to an n-stage shift register in 
parallel through some "EXCLUSIVE OR" gates. The encoder input 
sequence X is shifted into the k-stage shift register k bits at 
a time and outputs through those "EXCLUSIVE OR" s, or Mod-2 adders, 
and fed into the n-stage shift registers. The content of the n- 
8tar,e shift registers is the encoded block of the corresponding source 
block. The connection vectors between the two shift registers are 
equal exactly to the k rows of the generator matrix, or the k 
n-tuples that form the basis of the code space. 

If gjj ■ 1, there is a 
connection between x^ 
and y^ , otherwise there 
is no connection. 


Fig. 2,1 Parity check coder. 



For a low rate (1/n) convolutional code th^; only difference is 
that instead of shifting the whole block of k bits in, only one bit 
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u in « ..C tl« nnit. *• • mnnlt. « «, m*.rd th. 

,d>ol. sontc. ..qunnc. X .. • ...i-lntl.i» .o»rc blocK «.d th. 
generator matrln •« a eeM-lnflnlte natrlx: 


0 8 , 


^0 0 -*• “ 
- \ ° ^ ' 

\ 

QO 


where the 

l-l, 2 .e.kare equiva- 
lent exactly to the 
jg^’s of the corres- 
ponding block code. 


This for-letlon ten be eeslly ...n Iro. Fig. 2-1. *• “>«" 

.long tb. npper sbllt register. It „1U e«nto.U, occop, .very steg. 

thet their oconp.tlon of the se« steg. Is delayed on. tl.. unit 
successively. This Is «h, we nay visualise «, . a. being «.ltlpll.d 

by g,. gf gf - ■■■ *'■ 

that th. nultlpllcatlone are delayed one tls» unit, or n bite, for 

. e eource bit. For convolution.! codes, nor«.lly a con- 
each successive source dxc. 

► n mod-2 adders and then 

uutstor is used to senple the outputs of the 

CO send the encoded seouence out for transnlsslon. 

This analogous formulation of the convolutional codes n 

reveals some of the algebraic properties It Inherits from the linear 

block codes such as the property of linearity, but .1.0 provides a 

decoding method slmll.r to that of the block codes. That Is. if the 

I mat riyi U can easily be found; 
code is systematic, a parity check matrix 

1 Af the block codes can 

therefore, the same decoding procedure as tha 

be applied. 

The block code model of oonvolotionel code, elso r.ve.l. their 
,o„er end llmltattona. hue to their recurreht neture. convolntlooel 
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cod.. .Uo. th. ~tU. «ur« »,u.nc.. ..y I bit., to b. .«od.d 
.. on. »hoU block vlth «cy •»««“"« 

.tor.(. roq<ilt.««t. Snp.rfUt.Uy. It ...« th.t th. nltl«t. 

.. V j Bt.l < ?'*‘**0 * *»* could b. nchloyod with 
rimdoift codittg bound P[£J 2 

P[cl * 0 . »h.n N . (I + » n ♦ - . Ho««r. th. proof th.t tht. 
bound 1. v.lld d.p.nd. .tronsly on fro.do« to choo.. th. block-cod.r 
connoctlon vector. .rbltr.rlly. Ih. .ddltlon.1 con.trUnt of being 
recurrent exectly destroy, .uch freedo. .nd luat. th. choice of good 
code.. Indeed. If I l» lnct.»iod uhlle k . the encoder conetrUnt 
length. 1. held fixed, error probrt,lllty cunot be expected to 
epproech ..ro « » > » • On th. other h«.d. It t. r.»on-,l. to 
sntlclp.t. . bound on error probeblllty th.t decroMO. expon.ntl.lly 
with . lln..r mere... In encoder' s con.tr.lnt length k . A. .Ill 
be ,ho.n Uter, eerety locre«lng k will lncr.«.e the decoding con- 
plexlty exponentUU, tor th. optl«l elgorlthn. Even ,o there ere 
lUltntlon., the convolutlonsl code, .re still, by ter. th. best k.o« 
codes lnpr.ctlc.l sltustlon. hecsusc of their seiri-lnflnlt. block 

length nature. 

so f.r, .. hsve only considered th. low r.te 1/n cod s. For 
th. g.ner.1 t/n codes. .11 .. hsve to do Is to uc. . sets of 
th. construction .s shown In Fig. 2.1. -'d the corresponding output, 
of th. t k-,t.ge shift register, sre ~d-2 sdded together before 

being sampled, Fig. 2.2. 
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Ih« general Mtrlx>formulatlon: 
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In genaral the parity check watrlx ^ is extremely difficult to 
find, except when the codes generated are systematic. For systematic 
codes the connection vectors are such that 


1 when J • t 

0 when ,1 < 

0 when i 1 


all for J j::. k 


Z2 


Th»r«for«» all that hav« to bo opoclficd art tho ^ ^ * 

A woro coiuprohoiialvo #ot of notations can bo borrowod from Shu 
LlnS book.*^ Lot 
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vh«r« (1) X t X A Idsntlty matrix 

(2) 0 is a 1 X 1 sero matrix 

(3) Is a lx (n-l) matrix of the following form 


P - 


g’d.l), g’(l,2), 

r X 

a;(2.i), g;<2.2) 


gy(l»l)» gy(l»2)* 


g'(l,n-l) 

r 

g;(2,n-l) 


gjld.n-l) 


With such notations the generator matrix of systematic (n,l) convo- 


lutional codes Is of the following form: 
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I 0 p, a 


0 I Po 0 ?! 0 Pj 


0 0 i lo 


zeros 


0 “ 


Jk-2 » Ek-I - - 


0 Ik-2 a Ik-I *"»■ * 


i lo 0 I, 0 Is- 


and the parity check matrix H isi 
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I IS .« (n - 1 ) « (« - *"“-•*“ 

s („ - O SS.O ^trix. «it. -t- C. S. ^ 

sncodlss sn^ ^«oai», c.n b. pstlor-sd ™ch « ths, sr. i« • 

cods.; t.s si« o' •” “ 

l„™ids.l. ss ths, .SCO. »». lo t..s rscsrcnl nsluc ,1 tH... 

™,trlc.s. ths only ln£.».tl«n ossdsd is 0.. F^'s. th^r «y • 

grouped togsthsr » th. -o cUsd sub-gsnsr.tor: 

gU.l) ■ UoU.i). - Vl“-«> 

1 <> t 1 • l.|2» • • • 

for i - It 2, • J 


t n<toa has the followleS 

J4 « rtf convolutional codes »•» 

Algebraic decoding of convox 

.dv«t.,..= ,«„Uc.tlon. o« th. «»lved 

(11 It involYM only ■.ItlpUcntlo 

™ tt Mjoyn the operntlonnl 

„a tn. parity 

,p«d .d««.t.8e al-pl' rlrt“i‘'»- 

( 2 ) It do., not prop.«.t. ‘tror 

time units. ^^tter than 

(3) Its burst correcting cap 

other decoding algorithns. digits at a time, 

cince the decoding is performed 

the d as the prbbabilistic algoritf., conse- 

“ I ir rrr.ttln. .MUty L .reatly l-plr.-- 

““ Ttio* cod... tn. .trot corcctln, cpa^lUty lor 

“l el .Uo dopand. on tn. -nl.- -r-ic 

convolutional co these codes, the 

„d» 0 td.. on. to tn. ..al-1— ^ 

--'“T :-:ni..ii--““ 

d.fln.d .. £r.. dl.t.««. £».• a,.t 

A which is used in tne s» 

ainitnum distances, decoding is applied. 

_ of the distance when algi- 

tt is a measu 

It.. 0.ln PHI. 1. a««‘» 

cated, ther probabilistic decoders in random error cor- 

decoders are in lust as with 

r.ctlon.. anotnor lnport».t con.ld.r.t- 1. 

H1„C cod... .ytcaallr encodln. 8... 
d convolutional codes. This fact was 

r.iio 
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bit ^ 

FI,. 2.3 tll«.tr.t.. four of th. bound, uhlch b. obtrinrt. It t. 
cl..r th.t In nlio.t ny cm. . non.y.t«Mtlc conuolutlon.1 cod. 
»111 b. . nor. pcrful error corr.ctor thM . oy.tM.tic code. 



Fig 2.3 Free distance bounds.^® 


will b. dl.cuM.d leter. th. n.Jor pert of thl. work u to 
develop on elgorlth. uhlch ellou. . convolutlon.1 code to b. decoded 
by tuo decoder., m nlMbr.lc decoder Md . probMIlletlc decoder, 
Interfoced together. In order to .chieve uxlnum perfonunce, m 
•I gebrMc decoder th.t ellou. the decoding of non.yetM.tlc cod.. 1 . 
doMed neceMery, for othecule. It. rMdon error correcting cm.- 
bility uill be ecrly UnltM. Onlortunefly, no uork hM b.M don. 
In th. dev.lopn.nt of .IgebrMc decoding for non.yetM.tIc codM. 
except thnt Robert W. BoydI» propoeed m elgorlthn uhlch I. cM*le 




27 


of correcting short bursts of one block long» i.e«i n bits* In 
Chapter IV » this algorltha will be modified and extended to exploit 
fully the error correcting capability of the codes xised. A good code 
should be able to behave like an optimal B2 burst corrector^ and It 
will be shown that this Is Indeed so for the example (2»l)i k « 7 
code* 


2*3 SequentlaJ Encoding and Probabilistic Decoding 

Convolutional encoders can also be modeled as finite state 

machines and realised as such* This fact can easily be seen from 

Fig, 2.4. As mentioned previously* for a convolutional code, the 

code block depends not only upon the present Input bit but also the 

k-1 

previous k’-l bits. Since there are 2 possible patterns for the 

previous k-1 bit streams, we may regard a constraint k encoder as 
k“l 

having 2 states. The output of the encoder depends on both the 

present input bit and the present state of the machine, i.e. the 
encoder. In fact, convolutional codes are mainly applications of 
linear sequential circuits. Other applications of sequential clr^ 
cults are much simpler. For instance, we may want to realize a 
sequential machine that gives us a prescribed output sequence for a 
certain input history; output sequences of other input paths are 
ignored as long as they do not interfere in the generation of the 
prescribed sequence. However, for the encoding of convolutional 
codes, we must consider all the possible input sequences, and the 
function of the machine is to map the input sequences into the out* 
put sequences in such a way that the minimum distance between any two 
output sequences be the maximum possible, a formidable task. 
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Therefore, the present methods of finding "good codes" or "good 
machines" is limited to being empirical and analytical. No synthesis 
procedure has been developed yet. This is the major difference 
between the application of linear sequential circuits to convolu- 
tional codes and to other purposes. Until more is known about the 
characteristics of the finite state machines and the structure proper- 
ties of their output sequences, there probably will not be an inq>or- 
tant breakthrough. 

The decoding of convolutional codes amounts to nothing more than 
the recovery of the input sequence from the knowledge of the received 
sequence. The received sequence is the output sequence contaminated 
by noises during transmissl* n or by erasures during storage. Like 
block codes, the optimal decoding rule is to map the received se- 
quence to the most likely source sequence. However, because the 
received sequence is t'emi-lnflnltly long, it is rot practical to 
wait until the entire sequence is received before decoding. If this 
were done, the amount of storage and number of computations required 
would be beyond our imagination. Fortunately, convolutional codes 
are not randomly chosen block codes with arbitrary block length; 
they are recurrent codes. The complexity of convolutional codes 

depend on their constraint length k . For an - code, the encoder 

n 

k-1 V 

has 2 states, and the total possible output patterns are 2^ for 

binary inputs. Thus, intuition tells us that the additional error 

probability caused by considering truncated received sequences for 

MLD (maximum likelihood decoding) should be decreasing exponentially 

with increasing truncation length— this is exactly so. Fomey^^ 

used random coding arguments to show that on the average, a 
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„.c.Uo. WH o. ..out 5(.-» -t. U « 

probtlUt, th.t U c.^..bl. to th. MU, .trot proMoblllt,. ^ 

Ho— ti .od Co.t.llo“ dorlvod » boood »d . £or-.l. 

lot. th. bit .rror probablUt, do. to tronc.tlo. of th. r.c.l«d 
,.,0.1,0. for MLD. They foohd th.t. .t l.«it for loo v.l«.« 

If th. r.c.lv.d „..,«.nc 1, tronctod to Uogth T ,och th.t d^ 

„K»h<Htv wilJ be insignificant com- 
d the truncation error probability wiu 

ftee j the minimum distance 

p.r.d to th. MLD .rror proh-,lllty. «h.r. d^ i* ‘b. 1. 

«ll Other possible sequences at 
h.to..o th. corroot ..,o.n« md .11 othor po 

V Itv T is only a few times the encoder’s con- 
length T. Normally. T is oniy 

straint length k. 

The sequential or finite state machine formulation of the 
lotfon.1 cod., o.„ b..t b. ill».tr.t.d olth «. .x~pl.- Soppo.. • 
„r. i cod. 1. to b. i.pl.-t.d Olth th. clrcolt .hoon 1. FI,. 2.1 
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it obviously a sequential clr . ^ 

dl-graa c«, be developed to depict the Lc l 

"" the trelli, disgral"! 

•. ..e ^ “• .« 



s«te dlagr„ ,„d 


The Information on these 

-- - -- .z::r •"- 

- -- — - 1 : .“r- 

Instance, ify-(oioiin ^ ^ ‘defined. For 

from the „l„Zy .tructurod state dl ° ^ » •••). 

« roo «.. that th. *" “““ "‘fram 

ronvolutloaai encoders are not ool 

■“rl-ln... hut vet, .peeUl types a, ,e 

- -f - ~t.o„az cl t:rr 

.o,ue„tdaZ machl : 
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linlte stages and soma "EXCLUSIVE OR’s". 

*. ..ntlonsd sstllsr. the optlnsl dacdin. rnls I. to «g th. 

recslvad ssgnanc. to the nost Uksl, sontos ssgusncs. l.e. 

llksllhood decoding. ILI. t. che bsslc gtlnclgle enderlylng .11 

^.coding „tbods, It spglie. co block codes ss .ell .s con.ol^lon.1 

For llneer block codes. HLO sls^Uf,.. co the «gpl„g „f a,. 

received vector to the code vector .bleb differs fro. It In the le«.t 

number of places among all oth.*r vectors In ^h« d 

r vectors In the code space. Though 

convolntlonsl code, can be treeted the s... „ i,„,„ 

by trencstlng the received segnence Into abort blocks of a fined 

««»ber Of bits. l.e. algebraic decoding, tbelr se.l-lnfi.it. block 

length adventsge vonld be greatly sacrificed. <b. the other b«.d. If 

«.e entire length of the received segaence be considered before . 

decision is made, the complexity of decoder and m 

-r y U4. aecooer and time consumed would 

be astronomically high. 

A radical innovation, which alleviated this proble. ... the 

Proposal^of the slgorltb. called "segnentlal decoding" by „ot«.cr.ft 

IW57). ihe Slgorltb. ws. snb.eguently refined by R.lff.„.s 
Fano. 

The b«,lc Idea of segnentlal decoding can be lllastrated nalng 
the tree dlagrs. which Is sleply another for. of the trelll. gi.,... 
or the state dlsgra.. The tree structure can be ..tended lnd.fl- 
oltely to the right; however. It repeat. Itself after k level, due 

the recurrent nature of the code. There are 2^ branches stemming 
from each mode for an (n,i) code. 

0BH51NAU FAGB h 

OB VOOR QUAUTV 


00 



- - — . j rr: 

•- «-v .« :rv"“*""-. -- 

u ©rim onch node, onlv % 

“ “P«n « c.„h d.c„..„, „ 

to truncating the received se , , Thla la 

possible and decoding each hi T" * 

lock algebraically accord 

->.= fo«. . e„^„,„„. HU> 

"■ '“»«.e«l, th« t... 

^.PXP .. clrc«„,„„. ^ '» -«k « 

.rro« e«ut,. w — 

‘•inning threshold. During '' 
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b« t«wpor«rlly h*ld i»\ * buffer «tor«g«. If th« ch«n««l l« v*ry 

noisy for s c«rt*in period of tlwe «nd the ••nrchbnck l» extensive, « 

tremendous smoimt of buffer cspnclty vlll be required. Unless the 

buffer capsclty is msde Infinite, there is slwsys « finite possibility 

of buffer overflow owing to the feet thst there is slwsys s finite 

possibility of hsvlng extensive sesrch to the point where overflow 

occurs. In order to svold buffer overflow for s certsin fixed buffer 

sise, the chsnnel Inforwstlon rste must be limited to s figure much 

lower thsn the cspsclty of the chsnnel; this figure is termed compu- 

tstlonsi cutoff rste . Although the sequentisl decoder msim the 

comp 

received sequence to the code spsce sccording to the MUD rule, the 
sddltlonsl error esused by buffer overflisi or slternstlvely, the 
limiting of chnnnel rste to renders it s subopt imsl decoder. 

For those wi»o a»-e Ismllisr with optlmsl control theory, sequentisl 
decoding esn he viewed ss s discrete llnesr t recking problem end the 
algor ltl»« Is .analogous to the nvellunl of dynamic programming, the 
objective is to ralntmlae the Haiwning distance between the code se- 
quence and the received sequence. The admissible stale trsjectories 
consist ot the entire code space and the control policy is the decoded 

s;nce searchbaoks impose a severe limitation on the »>erformsnce 
of the sequential algorithm, a novel apprv'ach is to keep a running 
score or brands metric on each of the «x'st likely paths leading 

to each state. 11»e selection ot the desired path is postponed until 
sonw I ins* later to avoid a hastv decision widch might he ix*gretted 
later, lids is the basic idea of the optimal MU> algorithm developed 
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by Vlterbi.^® If all the posaible paths have to be saved and 
decision making has to be postponed indefinitely, this algorithm would 
have no advantage at all, because the entire semi-infinite sequence 
would be treated as one whole block. However, the objective is to 
find the path that correlates best with the received sequence. It 
can be shown^^ that among the 2^ paths entering each state at each 
level, only one path, l.e. the path that correlates best with the 
received sequence up to that stage, can be a possible candidate for 


the overall maximum likelihood path; the rest of the paths can be 
discarded. This will leave only paths, called the survivor paths, 
to be considered as decoding progresses along the trellis diagram. 
Furthermore, as mentioned earlier in this section, if a decision la 
made after 5(k-l) stages have progressed, the additional error 
probability due to truncation will be comparable to the MLD error 
probability and even less significant if the received sequence is 
truncated to length T so that d^ > d^^^. Since the Viterbi 
algorithm does not Involve searchbacks, buffer overflows do not occur 
and full channel capacity can be utilised. For these reasons, this 
algorithm is regarded as having truly maximum likelihood and as being 
optimal for the decoding of convolutional codes. The price paid for 
this optimality is the complexity of the hardware which grows expo- 
nentially with constraint length or linearly with the nuwber of 
internal states. However, if the constraint length is limited tc less 
than 10 stages, the hardware complexity will not grow beyond realisa- 
bility. An additional advantage is that Viterbi decoolng is performsd 
in real time, on a bit-by-bit basis; therefore, an Inp t buffer is not 
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required. This Is the algorithm intended to be used as part of the 
hybrid system and receives considerable attention in the next chapter 

where its burst error correcting capability will be discussed in 
detail. 

Details of the two probabilistic decoding algorithms discussed 
above can be found from references 15, 16, 25, 24, 27 28, and 29. 

2 ^ Special Codes- - <?ode8 for Burst Errors 

So far the discussions about error-correcting capabilities of 
convolutional codes have been restricted to their applications to 
W!Cs, l.e. channels containing random errors only. The free distance 
proposed by Costello^® as a measure of the random-error-correcting 
capability of a code does not apply directly to its burst-error- 
correcting capability. Codes suitable for some special burst error 
oattems are designed at the sacrifice of their random-error- 
correcting capabilities and are thus not generally optimal. 

Burst-error-correcting convolutional codes are divided into types 
B1 and B2, Tlie definitions can be found in Shu-Lln's An Introduction 
to Ejrrpr-correcttna Codes . Chapter 12. 

All the burst-error-correcting codes work well only when the 
channel Is segmented with error-free Intervals which are called guard 
spaces. This is why their applications are severly limited. A type 
B1 code is capable of correcting a burst of length L , i.e. L burst- 
error correcting code, provided that an error-free guard space of 
nk-1 digits Is given. A type B2 code Is capable of correcting a 
burst of length L ■ Xn , i.e. 1, phased-burst -error-correcting code, 
provided that a clean guard space of n(k-l) digits Is given. Since a 
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b»r.t Of ^ 

• typo B 2 oodo vlth phooid-orrot-corroctln, cpoblllty t . 
bo rojordod .. . typ. bi „do ,1th botot-orror-cortoctu* copAlUty 
- a-l)n 01 . A. L boco«. largo (,or ««j .) rho orror-cor- 
toctlo. copabiury bobwoaa rbo Co boco«. cry clooo. sl„o. Co 
»2 cod... duo to tb. additional roatrlctlon. ar. ...i.r to analya. 
«.<> tbolr porfocanc. ar. not cry «.b dltl.rct Iron tb. .1 codi. 
«.t pro^oc atudlo. .,ra condoctod In tbl. aroa. Ucr boond. on 
tb. londtb Of tb. guard apac. r.,mr.d for fled 1 ..r. 
by »yn.r and Aab.3« Tbl. boond .tataa that for a typ. .1 
coda. tb. conatralnt l.ndtb b noat a.tlafy tb. follci.g ic,cUty= 


fc > n ^ a 


or equivalently, 


n(k-l) > iL.t A 

~ n -> 1 


(An) 


where n(k-l) is the guard space and L - An tha. k 

An , the phased-burst-error 

correcting capability Iberefore. (guard apace required) > iULt , 
(borat length). An optlnal .1 

.dCtlon ultb equality, it cc be aeen that according to tb. Wyner- 

Aeb bo„„d.^tbe ratio of guard .pace length to c.i„un burat length 1 . 
exactly _ foj. ^ optimal B2 bur«t c- 

" ^ P max flaj burst-error-correcting convolutional 

code. 

The flrat burat-error correcting convolutional cod. ... intro- 
duced by Hagoibarger |l, 5 „ 3 ., u ... later refined by P.teraon ,1,61]” 
-.dete ,l,b„33 


37 


much shorter guard space than the corresponding Hsgelbarger codes. 
Type B2 codes were first studied by Wyner and Ash [1963]!® They also 
found some optimal B2 codes; these are (n,n-l) codes for n - 2, 3, 
and 4. Subsequently, Berlekamp formulated a general pro- 

cedure to construct optimal B2 (n.n-1) codes for any n . Although 
the burst-error-correcting capabilities of these optimal B2 codes are 
attractive, it is Important to realite that these are codes specially 
designed for burst error correction; in general their random-error- 
correcting capabilities are greatly reduced. 

Codes for both burst and random errors do exist; for instance, 
the diffuse code and the Gallager’s adaptive decoding scheme; however, 
the former is a systematic orthogonalisable code and the latter is 
applicable only to systematic orthogonallsable codes. None of them 
is optimal in burst and/or random error correction. 

Special techniques such as Interlacing or concatenation are not 
desirable because they either adUeve a burst-error-correcting capa- 
bility at the sacrifice of random-orror-capabillty or Introduce rate 
loss by using two codes, one Inside the other. Furthermore, it is 
impossible to make their performances approach optlmvm, for both 
random and burst errors. 

2 . 5 Concluat on 

Discussions in this duipter can be sumnwrleod as follows: 

(1) In general, convolutional codes are better r.-tndom-error 
correctors than block codes. 

(2) Hie best decoding algorithm for convolutional codes is the 
optimal maximum likelihood Vlterbl decoder. 
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( 3 ) The performance of the Viteibi decoder for channels with 
burst errors or with both random and burst errors is largely unknown. 

An original study is deemed necessary and will be the main efforts of 

the next chapter. 

(A) Good convolutional codes are those with large free distance; 
therefore, they are not likely to be systematic codes. 

(5) Algebraic decoders truncate the received sequences into 
short blocks; thus much of the random error correcting capabilities 
of the convolutional codes are not used. However, they provide 
better control over burst errors. Since all the known algebraic 
decoding algorithms are designed for systematic codes, an algebraic 
decoder for nonsystematic codes must be developed. This will be the 
topic of Chapter IV. 

(6) Special codes designed for strictly burst channels do 
exist; however, they are not suitable for random errors. 

(7) Special techniques for correcting conblnations of burst 
errors and random errors are also available, but they either intro- 
duce rate loss— for instance, concatenation— or reduce the random 
error capabilities of the codes, for instance interlacing. There- 
fore, these techniques will be excluded from further consideration 
other than for possible additional protection over the hybrid systems. 


CHAPTER III 


PERFORMANCE OF THE VITERBI DECODING 
ALGORITHM FOR CCMPOUND CHANNELS 

3* 1 Introduction 

A. B.ntlon.d in th. U,t chnpt.r, th. r.«doB-.rror-cor«ctl„8 

cap.blllty o£ th. Vlt.tbl d,codln, agorlth. 1. Utg.ly untaow. 
Existing .ork In thl. 1 . ,uit, vit.rt .1 g.cod.r. «. 

8M..r.lly very good for r«do. .rtor ch«n.l. but .r. not .. .fflclat 
for bur.t orror.,35 

from th. Vlt.rbl d.cod.r of opproxl.mt.ly 10 to 20 bit., dopradlng on 
th. d.cod.r con.tr.lnt length and th. .ncoder u.«1.36 

Mot. recent .tudle. ha,, reported th. perfonmnc. through malyt- 
ical .tatement. and comput.r alnulatlon. of ehort con.tr.lnt length 
convolutional code, ulth binary phM. ehlft keying (BPSK) modulation 
and Vlterbl decoding for coim.unlc.tlon channel, with cIm.Ic.1 ric1„ 
Fading. 36 Analytical prediction, of performance of convolutional 
code, have aleo been derived for buraty chm»eU;33 houever. Inter- 
leaving ... need prior to Vlterbl decoding, thl. 1 . .or. Ilk. a .tudy 
of the potential buret-correcting cepablllty of the code, rather thm. 
the performance of the decoding elgonthm. Interleaving t«,d. to 
Improve the bur.t-correctlng capability at the aacrlflce of the 
random-error-correctlng capability for a particular code. A. 
mentioned earlier, physical channel. In nature do conelet of both 
type, of error.. It .ould make «,r. .enae If method, of evaluating 
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the perforaance of the Vlterbl decoders over channels with various 
degree of memory could be constructed. 

Normally, compound channels are difficult to analyse although 
performance may be characterised through statistical simulation of 
various encoders and decoders for compound channels with various 
ratios of burst to random error statistics. 

The following sections present the method and the results of a 
computer simulation investigation of the performance of Vlterbl 
decoders when receiving data corrupted with burst and random errors 
on the same channel, the compound channel. 

3.2 Method of Stj^ ^d Some Preliminary Findinas 

Five encoders were modeled (see Table 3.1) ranging from a con- 
straint length of 3 to 7 and free distance of 5 to 10. Two decoder 
constraint lengths were utilized and overall channel statistics of 
10 , 10 , 10 bit error rates were simulated. The burst errors 

were Inserted at random within the random error stream and burst 
lengths of 2, 3, 4, and 5 or more bits were randomly distributed 
through the data with appropriately varying statistics. 

A comprehensive set of con^uter simulations for Vlterbl deco- 
ders with random and bursty error inputs was generated. The complex 
channels were simulated using a random nunfcer generator as were the 
source sequences. Although convolutional codes are linear group 
codes and their properties will be invariant if the all zero 
sequence is used, for esthetics and for detecting any nonlineari- 
ties which might occur in the hybrid decoding algorithm, the use of 
randomly generated source sequences seems more preferable. 
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TABLE 3.1 


TYPES OF DECODERS INVESTIGATED 


DECODER TYPE K V 

A 3 2 


HOOKUP VECTOR 

00007 

00005 



B 


00017 

00015 



C 


00020 

00032 





D 


00075 

00053 




E 


7 


2 


00133 
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The conputer simuletion of the Vlterbl decoding algorithm can 

beat be explained with an example, using hand calculations. In the 

following Illustrations, the rate y , K ■ 3 code discussed In 

Sec. 2.3 will be considered again. This encoder Is rather simple In 

form and short In constraint length (hence limited In error correction 

capability) but allows a demonstration of the type of error output 

sequences which occur from decoders using the Vlterbl decoding 

algorithm. The encoder Is a constraint length 3, rate ^ encoder 

shown In Fig. 3.1. A typical Input data sequence and coded output 
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sequence Is shown In Fig. 3.2. This code has a ^ 

typically capable of correcting two bit error patterns In a received 
sequence 6 bits long. 


3.2,^!, Decoder Operation ; 

A periodic section of the trellis diagram for this code Is shovn 
in Fige 3.3. This code has 4 states (2^ ^ • 2^ ^ ■ 2^ • 4) , these 
states with the corresponding outputs and transactions constitute 
the periodic section of the trellis diagram* 

On a BSC, errors which transform a channel code syni)ol 0 to 1 or 
1 to 0 are assumed to occur independently from syn6ol to syt!i>ol with 
probability p. If all input (message) sequences are equally likely, 
the decoder which minimizes the overall error probability for any 
code, block or convolutional, is one which examines the error- 
corrupted received sequence y^ y^, ... y^ ... and chooses the data 
sequence corresponding to the transmitted code sequence , x^g... 



Hamming distance; that is, the transmitted sequence which differs 


Date Sequence 
... * 3 * 2*1 




— T 


11 * 

^ 12 * 

^13 

21 

^22 

723 


Data Sequence Input x^, * 2 « *31 ♦•* 

Data Sequence Output ^ 11 ^ 21 ' ^12^22*^13^23' ' 


Where + *i-i "^^2 

^21 “ *1 * 1-2 


Figure 3.1 Convolutional encoder (k»3) 


Input Data Sequence 00 10 1 101 0100 1 1 01... 

Coded Output Sequence 00 00 11 10 00 01 01 00 10 00 10 11 11 01 01 00 .. 


Figure 3.2 Input and output data sequences 
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Buffer Memory 



Input Code Pair 



Input Code Pair Number 
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^Ive diagram of decoder operation elements. 


Fig. 3.4 Illustr. 
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nodes. For example, the comparison at node a after the fourth branch 
Is between the survivors of comparisons at nodes a and c after the 
third branch. Thusi If the received sequence over the first four 
branches Is 01000111, the survivor at tae third node level for node a 
Is 000000 with distance 2 and at node c It Is 110101 also with dis- 
tance 2. In going from the third node level to the fourth, the 
received sequence agrees precisely with the survivor from c but has 
distance 2 from the survivor from a. Hence the surviovor at node a 
^f the fourth level Is the data sequence 1100 which produced the code 
sequence 11010111 which is at (minimum) distance 2 from the received 
sequence • 

In this way, it is possible to proceed through the received 
sequence and at each step for each state preserve one surviving path 
and its distance from the received sequence, which is more generally 
called metric . The only difficulty which may arise is the possibility 
that in a given comparison between merging paths, the distances or 
metrics may be identical. Tlien one may simply flip a coin as is done 
for block codewords at equal distances from the received sequence. 

For even if both of the equally valid contenders are perserved, 
further received symbols would affect both metrics In exactly the same 
Way and thus not farther influence the choice. 

The internal operations of the decoder have been shown in the 
following examples. At the bottom of each of the examples the equiva- 
lent input and output error sequtMices have been shown. The arrows 
indicate the output digit the decoder will select for a buffer memory 
of 9 digits* Fig. 3,4 illustrates the make up of the block of 


A7 


operations and memories used in each decision step of the decoder. 

For the k - 3 rate • 1/2 encoder there are 4 survivor paths 
at>d 4 metrics to remember. For the k ■ 7 rata ■ 1/2 encoder there 
are 64 survivor paths and 64 metrics to remember. Thus, simulation 
of the k • 7 rate " 1/2 encoder will be considerably more involved 
than it would be for a k • 3 rate ■ 1/2 encoder. 

3.2.2 Preliminary Flndinga 

Immediate results from this short constraint length code can be 
summarized as follows: 

1. Viterbi decoder constraint lengths DCL (decoder buffer 
memory storage capability in bits) is an important parame- 
ter relating to performance. In general, the ratio of 
error clusters to decoder constraint length is directly 
proportional to unsatisfactory performance. In the example 
presented In Section 3.2.1, It Is clearly evident that 
although a buffer memory of 6 performs well for random 
errors, where It is very unlikely for 2 or more errors to 
occur within a space of a few bits of data. It produces 

a very poor performance for bursty error situations such 
as 2, 3, 4, or 5 errors confined within a short span of 
data. In fact. Increasing the DCL to 9 results In much 
better performance. This Is to be expected, but the ques- 
tions are what Is the relationship for longer constraint 
length codes ami where Is the point of limiting returns? 

2. Short spmts of errors often produce more errors than a 
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Decodlag With 3 Errors Using Buffer MsBory 9 and 6 


DATA INPUT ... ®1011010l00l 1 n 

°° 01 00 10 00 10 11 11 01 
00 11 10 00 01 01 00 n 5? A JJ 

Starting with Last Correct Sequence Received 


a 00 01 01 10 
b "OO 01 01 10 
c 00 00 00 11 
d 00 00 00 11 


00 


+ 




0 


0 

00 

00 

01 

1 


0 

00 

10 

11 

0 { 


0 

00 

10 

11 

1 1 


1 0 

00 

10 

11 


X 

11 

0 

1 

0 

1 


0 01 01 10 10 
0 01 01 10 10 
0 01 01 10 11 
0 01 01 10 01 


ro jll 01 00 10 
* 6 ‘ 11 01 10 00 
0 11 01 10 01 
0 11 01 10 01 


11 (fii + 

0 ®ii]io 11 00 10 

1 ® i 10 11 00 10 
0 ® 1 10 11 00 11 
1 0 1 10 11 00 01 


01 @ 

® w [ijoi 10 01 10 
1 ® i 01 10 01 10 
0 ® 1 01 10 00 11 
1 0 1 01 10 01 01 


* 

[ijoo 01 10 10 
i 00 11 00 00 
1 00 11 00 01 
1 00 11 00 01 


@ 

0 g [ojoo 11 01 00 

1 0 6 00 11 01 00 
0 0 0 01 10 00 01 
1 0 0 01 10 00 01 


o , + 

0 0 [q!oi 10 10 00 

1 0 0 01 10 10 00 
0 0 0 01 10 10 01 
1 0 0 01 10 10 01 



DATA INPUT SEQUENCE ... 
EQUIV ALENT ERROR SEQUENCE 
DATA OUTPUT SEQUENCE 
EQOIVA LENT ERROR SEQUENCE 
USING BUF PKR MENORT 6: 
DATA OUTPUT SEtHniRCE . . . 






OlOllOlOlOO 

XXX 

01011011000 
X X 

00011011000 
* » » 


10011010 
01 00 10 11 11 01 01 00 
01 01 00 10 11 11 01 01 


X 


01 

0 


♦ 

) 0 10 11 01 10 

1 


b 10 11 01 00 

0 { 

0 10 11 01 01 

1 { 

0 

0 10 11 01 01 


0 0 0 
10 11 00 00 
00 10 11 00 00 

X 

11 ® >. 

0 ® UjOl 10 11 00 

1 0 'i 01 10 11 00 
0 0 1 01 10 10 01 
1 0 1 01 10 10 01 


01 Q i 

0 0 iojii 00 11 00 

1 0 6 11 00 01 10 
00 0 11 00 11 01 
10 0 11 00 11 01 


00 ^ t 

0 ® i ijio 01 10 00 

1 0 1 10 01 10 00 
0 ® 1 10 00 11 01 
1 ® 1 10 01 10 11 


10 Q > 

0 ® iPjii 01 00 10 

1 0 0 11 01 00 10 
0 0 0 11 01 00 11 
1 0 0 11 01 00 11 


^ ,> 

0 ®U|10 10 01 10 

1 0 1 10 10 01 10 
0 0 1 10 10 01 11 
1 0 1 10 10 01 11 


110100110100 

1 

110100110100 


0 

1 3) 
1 ® 


Figure 3.5 


a* 

VO 


A - - j a (9 - ft ft 0 0 

00 11 

tECiivn) seqoM“: 

lift c» 0y fc Wlt^ 

S41Tt s«»~~ 


, :* *00 Cl 01 10 ' 

-’OO 01 01 10 

e 00 00 00 11 

^ 00 00 00 11 I 

* 3 

io'-ll 01 10 10 1 

o' 11 01 0® 1 

0 11 01 00 01 
0 11 01 00 01 1 

Totoo 01 10 10 ! 
“o ’ 00 11 00 00 
0 00 11 00 01 
0 00 11 00 01 

' l^Ol 00 11 00 
I'oi 00 11 00 
1 01 00 11 01 

1 01 00 11 01 


0 00 00 01 10 
0 00 10 11 00 
0 00 10 01 
0 00 10 11 01 


1 TiUo 10 00 10 

'V 10 10 00 10 
1 10 10 00 11 
1 10 10 00 01 1 


•o;oo 11 01 W ! 
'o 00 11 01 00 
0 01 10 00 01 
0 01 10 00 01 

;o';io 01 10 lo 
o' 10 01 10 10 
0 10 01 10 11 
0 10 01 10 11 





0 01 01 10 10 
0 00 00 11 00 
0 01 01 10 11 
0 01 01 10 11 

fiOl 00 01 10 
I'oi 00 01 10 
1 01 00 00 11 
1 01 00 01 01 


d';01 10 10 00 
o ' 01 10 10 00 
0 01 10 10 01 
0 01 10 10 01 

i i :00 11 01 w 
”i'oo 11 01 00 

X 00 11 01 01 
1 00 11 01 01 



X 

* ®® 

10 11 01 M I ® 

6 10 u 01 10 1 

0 10 u j ? 


11 01 11 


00 

6 -10 00 ® 
d 10 00 01 10 I 
0 10 00 11 01 I 
0 10 00 11 01 1 

o'! 11 01 00 10 

d 11 01 00 10 
0 11 01 00 11 
0 11 01 00 11 


d';01 10 10 00 
d'oi 10 10 M 
0 01 10 10 01 
0 01 10 10 01 




1 01 10 10 W 

1 01 10 10 W 
1 01 10 11 01 
1 01 10 11 


IjOO 01 10 00 
'1 00 01 10 00 
1 00 00 11 01 
1 00 01 10 11 


'I'.io 10 01 10 
i'lo 10 01 10 
1 10 10 01 11 
1 10 10 01 11 


dUl 01 00 00 
d 'u 01 00 00 
0 11 01 00 01 
0 U 01 00 01 
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Decoding With 5 Errors Using Buffer MesK^ry 9 and 6 


data input ... 

Code Sequence. 


DO 01 01 00 10 00 10 11 u ii Si 

«ecel,^d Seq. . OO 11 10 00 01 01 00 if of if ig u og oi 
Starting With Last Correct Sequence Received: 


10 0 1 
00 10 11 11 

00 10 11 11 


10 10 0 
01 01 00 10 11 

01 01 00 10 11 


0 0 
00 00 

00 00 


4- 

a 00 01 01 10 
•» 00 01 01 10 
C 00 OC 00 11 
<* 00 00 00 11 


00 6 4 

0 0 0 00 00 01 10 
1 ® 0 00 10 11 00 
D 0 0 00 10 11 01 
1 0 0 00 10 11 01 


.4.. 

i.Oill 01 00 10 I 
0 11 01 10 00 I 

0 11 01 10 01 I 
0 11 01 10 01 ; 


11 

0 

1 

0 

1 



il.'lO 10 01 00 
1 10 11 00 10 
1 10 11 00 01 
1 10 11 00 01 


4 

i.i;00 01 10 10 
0 01 00 00 00 
0 01 00 00 01 
0 01 00 00 01 



: 0;00 11 01 00 
0 00 11 01 00 
0 10 00 00 01 
0 10 00 00 01 


X 

11 

0 

1 

0 

1 



4 

0 01 01 10 10 
0 01 01 10 10 
0 01 01 10 11 
0 01 01 10 01 


X 

01 

0 

1 

0 

1 



4 

io.jio 11 01 10 
0 10 11 01 00 
0 10 11 01 01 
0 10 11 01 01 


DO @ ..f, 

0 ^ i.ijOl 00 10 00 

1 © 1 01 00 10 00 

0 © 1 01 10 00 11 

1 © 1 01 10 01 01 


01 

0 

1 

0 

1 



Lojio 01 00 00 
0 11 00 01 10 
0 10 01 00 01 
0 10 01 00 01 


X 

11 

0 

1 

0 

1 



iijol 10 11 00 
1 01 10 11 00 
1 01 10 10 01 
1 01 10 10 11 


00 

0 

1 

0 

1 



.4 

fijoo 10 00 00 
1 00 10 00 00 
1 10 00 11 01 
1 00 10 00 11 




[ojOl 10 10 00 
0 01 10 10 00 
0 01 10 10 01 
0 01 10 10 01 



010 


00 0 


data input SEOUENCE ... 
M}0IVALEHT error seq. 
data OUTPUT SEQUENCE..* 
eqdivaleht error seq... 

wnw BUFFER HEMORT 6. . 

data outfot 


0 1 0 1 1 0 1 
0 1 0 1 1 0 1 

0 0 0 1 1 0 1 

X 


0 10 0 110 
X X X X X 

1 0 0 0 1 1 0 

X X 

0 0 10 110 

X X 


^00110100 
10 0 

10 0 


Wgure 3,7 


».codl« «... S ’ •"* 


data ihpot . . . 

Code Sequence. 


on nilOlOlOO 

M 11 10 00 01 01 00 10 00 10 11 


j r. no 11 10 00 01 01 00 11 00 11 10 

Cr..c. «.««« "“‘ r ' 


1 1 0 1 0 

11 01 01 00 10 

XX 

11 10 01 00 10 


’.00 01 01 10 
■•'oo 01 01 10 
00 00 00 11 
00 00 00 11 i 


iOjOl 10 00 10 
^0 11 01 10 00 
0 11 01 01 11 
0 11 01 01 11 


0 00 00 01 10 
0 00 00 01 10 
0 00 10 11 01 
0 00 10 11 01 


I ioill 00 01 00 
) 0 11 00 01 00 
) 1 10 11 00 01 
) 1 10 10 11 11 


io^ll 11 10 10 0 a 
i 00 01 00 00 IQ 
1 00 01 00 01 ore 
0 11 11 10 11 1 ® 

DATA wm SEQUENCE. . . 

equivalent error seq.. 
data output sequence. . 
equivalent error seq.. 

USING BUFFER MEHORY 6. 
data OUTPUT SEQUENCE. . 


• 1 ]11 11 01 00 
1 11 11 01 00 
0 00 10 00 01 
0 00 10 00 01 


nllOlOOOO 
11 11 01 01 00 10 11 00 00 

11 11 01 01 00 10 11 00 00 


0 00 00 11 00 
0 01 01 10 10 
0 01 01 10 11 
0 01 01 10 11 


I . I'i 01 10 00 10 
I i^oi 10 00 10 
) 1 01 01 11 11 
) 1 10 00 10 01 


ii 11 10 10 00 
I rii 10 10 00 
) 1 11 10 10 01 
) 1 11 10 10 01 


0 1 0 1 1 0 1 0 I 0 0 1 

0i0010l5lll‘ 

X * 

0 0 0 1 1 1 0 1 0 0 i ^ 

« X X X X X 


io'lio 11 01 10 

■ ‘O 00 01 10 00 
0 10 11 01 01 
0 10 11 01 01 


ffi ) : 6;11 00 01 00 
©■•d 10 11 11 10 
@ 0 11 00 01 01 
© 0 11 00 01 01 


0 ©aill 01 00 10 OC 

1 © i'll 01 00 10 1 ( 

0 ® 1 11 01 00 11 0 

1 @ 1 11 01 00 11 1 ’ 

1010011010 


10 1 


rfioi 10 11 00 
■ i'oi 10 11 00 
0 00 11 00 01 
1 01 10 10 u 


t i ilio 00 10 00 
)‘*ri0 00 10 00 
> 1 01 11 11 01 
i 1 01 11 11 01 


►rii 10 10 01 10 

> I 10 10 01 10 
) 1 10 10 01 11 
) 1 10 10 01 11 


Figure 3.8 


of received signals; of course » during this tine the output 
Is highly unreliable data. 

3.3 Results and Findings of Computer Simulations 

Computer simulations of Viterbi decoders eidilbltlng input data 
with both random and bursty error patterns are summarized In this 
section. The data runs were made for three Nominal Error Probabili- 
ties » 10% » 1%» 0.1% » with the burst error percentages composing half 
the total percentage. Bursts were spread over various ranges with 
lengths 1, 2,’ 3, 4, and 5 or more with varying percentages of the 
total error percentage. 

Fig. 3.9 shows a typical print out for a data run with the 
statistics that were compiled. 

Data runs were made for both 2000 word strings and 200 word 
strings to determine if significant differences might be encountered, 
thereby Implying that a 2000 word string might not be long enough. 

Two decoder constraint lengths were used to ascertain the effects of 
this parameter and five encoder constraint lengths were used to 
determine whether longer encoders achieved better performance than 
short encoders. The channel error statistics used were rather noisy, 
varying from error rates of lo’^ to lO"^ bit error rates. These 
rates allowed shorter computer runs while the performance chacter— 
istics were still Indicated. 

Table 3.1 Illustrates the type of decoders modeled with the type 
E being comparable to the Viterbi decoder being used with the Space 
Shuttle Communication System. 
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Figure 3.9 Typical printout of the simulation 
program - Viterbi decoder 
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Figure 3.9 (cont.) Typical ptintouc of the simulation program - Viterbi decoder 
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Table 3.2 lists the parameters varied for each type of decoder 
and Table 3.3 lists the parao; ers tabulated for each data run. 

Some parameters have been summarized by tables to facilitate 
discussion and to illustrate the performance of these decoders. In 
Table 3.4 the overall probability of error with coding is compared to 
the overall probability of error without coding by ratio. These num- 
bers should be interpreted in the following manner. If the coding has 
helped the system, then the output error probability should lower 
the error probability without coding. Thus, in the extremes the ideal 
ratio is 0.0 and the worst ratio approaches • with a ratio of 1.0 
indicating that no help is indicated by coding. 

The statistics in Table 3.4 can be somewhat misleading if one 
does not realize that these are overall statistics which do not reflect 
the reduction of the number of errors in words (if any). In Table 3.5 

a comparison of the reduction in the nuad>er of errors in words is 
presented. 

A feeling for the benefits obtained may be gained if one realizes 
that the output of the Viterbi decoder may be corrected further. For 
instance, the Space Shuttle Digital Data Link will further decode some 
special data words, the synch words. 39 xhese words, being encoded in 
a triple error correcting code word, are capable of correcting all 
errors in a word of 3 bits or less. Thus, it should be determined 
whether the Viterbi decoder, even in the face of bursty errors, has 
reduced significantly the errors per word of 4 or more. Data in 
Table 3.5 indicate that for channels of lo"^ BER or less there is a 
good reduction of these words of 4 errors or more. The significance 
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of this lies In the synch-lock system of a coimminicatlon system. The 
communication system will lose lock and enter a probation or a search 
node if more than 3 errors occur in a synch word. If the search 
node is entered, data is lost by the frane and this results in con- 
siderable data loss. 

The Viterbi decoder is rather unpredictable with respect to 
decoder size versus burst error performance as may be seen from 
Table 3.5 for the cases of decoders C, D, and E for 0.1% NEP. These 
decoders are longer than types A and B and in theory should do better 
in that they are capable of correcting more errors per word than A or 
B. However, when these decoders make mistakes, they take longer to 
re-establish the correct bath. 

The purpose of a hybrid decoding system is to add a "quick look" 
decoder which can spot burst errors and the error free space which 
comes after. The output of the "quick look" decoder may be used 
during the error free space to reset the Viterbi to a best guess path 
which should help to alleviate the disadvantage of the longer coders. 

Table 3.6 presents a summary of the error statistics for the 
2000 word simulation for nominal channel bit error rates of lO”^ and 
10 ^ The actual channel error rates were 1.5289 x lo"^ BER and 
.1078 X 10 BER. The decoded data output bit error rates are pre- 
sented as well as the probability of x errors per word occurring for 
X ■ Op Ip 2p 3p 4p and 5 or more errors per word. 

Conclusions to be drawn from these simulation runs are summa- 
rized below. 


1. The 2000 word simulations for BER of lO"^ and 10“^ 


seem 
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to be long enough data runs for accurate results. The 
BER of 10 ^ seems to be long enough with perhaps one or 
two cases that would be more reliable with longer data 
runs. 

2. The longer DCL decoders for the type C» 0 and E decoders 
are necessary for good performance by the decoders. This 
is reasonable when one considers a normal DCL of 4 to 5 
times the encoder constraint length. 

3. Error rate improvements of roughly an order of magnitude 
were typical for the 10 ^ BER longer DCL decoders. 

4. The probability of words occurring in the decoded data 
stream that contained more than 3 errors (hence rendering 
a synch word unusable if the errors occurred in a syndi 
word) were rtiiuced significantly for the type E decoder 
using a DCL of 35 and BER of 10~^. (Probability of four 
errors or more before decoding was .6000Z versus .0502 after 
decoding.) 

5. The probability of words occurring in the decoded data 
stream that contained more than 2 errors (hence rendering 
a synch word incorrect and creating a possible loss of a 
frame of data due to false synch loss) was reduced from 
1.000 X to .0502 after decoding for the type E. DCL of 

35 decoder. 

6. Longer data runs are necessary for the type E decoder with 
DCL of 35 to ascertain that the results are not unique to 


this run. 


For the same overall channel error rate, the relative 
order of magnitude of degradation varies from 10 to 100 
when the channel contains both random and burst errors 
as compared to the random only situation, Fig. 3.10-3.1A 



TABLE 3.2 

PARAMETERS VARIED FOR EACH TYPE DECODER 


No. of Source Words; 


2000, 200 


Total Nominal Error Probability 
in Simulation; 


10%. U. 0.1% 


Decoder Constraint LenRth (DCL) ; 


TYPE DECODER DCL VARIATIO ^^ 


A 

B 


9. 15 

12, 20 


15, 25 


18, 30 
21, 35 



LLUJJJ J U 
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TABLE 3*3 

PARAMETERS TABULATED FOR EACH TYPE DECODER 

A. Error Statistics Actually Occurring in Error Vector During 
Simulation 

1* Number of Errors in a row: 1, 2, 3, 4, 5 or more 

2. Error Probability in % in terms of frequency of occurrence 

3* Error Probability in % in terms of total number of bits 

4. Number of times a particular number of errors in a row 
occurred 

&• Error Statistics as They Occur in the Received Sequence Before Decoding 

1. Same as A1 above 

2. Same as A2 above 

3. Same as A3 above 

4. Same as A4 above 

5. Number of errors per word 1, 2, 3, 4, 5 or more 

6. Number of times a particular number of errors in a 
word occurred 

7. Error probability of item 6 in percent 

C. Error Statistics as They Occur In the Decoded Data Sequence 
Same Items 1 through 7 for B above. 

D. Improvement of the Channel Due to Coding - in Terras of Error 
Probability Per Bit 

1. Ratio of Error Prob. (with coding/without coding) 

[Note ideally the ratio of item D1 Is 0.0] 

2. Decreasing of Error Prob. (without coding/with coding) 


TABLE 3.4 


OVERALL CHANNEL IMPROVEMENT RATIO VERSUS TYPE DECODER, DCL, HEP, NSW 



DECODER 

DCL 

NOMINAL ERROR 
PROBABILITY (W^ 

NO. OF SOURCE 
WORDS (NSW) 

CHANNEL IMPROVEMENT, 
(PER BIT BASIS) 


TYPE 







2000 

.840069 


A 

9 

10% 

200 

.849218 





2000 

.448648 


A 

9 

U 

200 

.351064 





2000 

.362319 


A 

9 

O.IZ 

200 

.30000 





2000 

.799468 


A 

15 

lOZ 

200 

.826021 





2000 

.277976 


A 

15 

IZ 

200 

.308511 





2000 

.231884 


A 

15 

O.IZ 

200 

.400000 

o 

7 ; 




2000 

.900843 

B 

12 

lOZ 

200 

.884518 

1 Si 










2000 

.345427 

Ip 

B 

12 

IZ 

200 

.404255 





2000 

.231884 


B 

12 

O.IZ 

200 

.50000 





2000 

.814191 

rp 

B 

20 

lOZ 

200 

.835098 


/ PBOW. OF ERROR WITH CODIMG > 
VproB. of mOR WITHOUT 0)0^0) 


ON 

ro 



TABLE 3.4 
(Continued) 

OVERALL CHANNEL IMPROVEMENT RATIO VERSOS TYPE DECODER, DCL, HEP 


NSW 


DECODER 

DCL 

NOMINAL ERROR 

probability (nep) 

NO. OF SOURCE 
WORDS (NSW) 

mAHNTT. improvement (PROB. OP ERROR WITH CODD^) 
(PER BIT BASIS) (PROB. OP ERROR WITH CODOK;) 

TYPE 


2000 

.239142 

B 

20 

IZ 

200 

.329787 



O.IZ 

2000 

.188406 

B 

20 

200 

.500000 



lOZ 

2000 

.941907 

C 

15 

200 

.9238533 




2000 

.603986 

C 

15 

IZ 

200 

.478723 




2000 

.666667 

C 

15 

O.IZ 

200 

.700000 








2000 

.940754 S > 

C 

25 

lOZ 

200 

.937973 ^ 




p P 




2000 

.599898 

C 

25 

IZ 

200 

.478723 








2000 

.666667 

C 

25 

O.IZ 

200 

.700000 


decoder 

TYPE 


D 


D 


D 


D 


D 


D 


E 


E 


TABLE 3.4 

OVERALL CHANNEL IMPROVEMENT TTPE DECODER. DCL. NEP. NSW 


DCL 

nominal error 

PROBABILITT (irep^ 

NO. OF SOURCE 
WORDS fNSW^ 

CHANNEL IMPROVQIENT 
(PER BIT HAfiTizS *" 

18 

lOZ 

2000 

200 

1.441064 

1.345436 

18 

IX 

2000 

~2W 

.812468 
. 702128 

18 

o.u 

2000 

200 

. 768116 
.500000 

30 

lOZ 

2000 

200 

1.223415 

1.222390' 

30 

IZ 

2000 

200 

.15846 

.170213 

30 

o.iz 

2000 

200 

.00000 

.00000 

21 

lOZ 

2000 

200 

1. 705632 
1.795260 

21 

IZ 

2000 

200 

. 743996 
.712766 




TABLE 3.4 
(CONTIHUED) 

OVEKALL CHANHEL IMPROVEMENT RATIO VERSUS TYPE DECODER, DCL. HEP, NSW 


DECODER 

TYPE 


NOMINAL ERROR HO. OR SOURCE CHANNEL PgROVBIEIIT^ (PROB. OF ERROR WITH COTIHC) 

PROBABILITY (HEP) WORDS (NSW) (PER BIT BASIS) (PROB. OP ERROR WITHOUT OODIK) 




O.IZ 

2000 

.855072 

E 

21 

200 

1.100000 



lOZ 

2000 

1.452056 

E 

35 

200 

1.654049 



IZ 

2000 

.106285 

E 

35 

200 

.106383 



O.IZ 

2000 

.086951 

E 

35 

200 

.500000 


« 


V/v 
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TABLE 3.5 


WORD ERROR RATE IMPROVEMENT VERSUS TYPE DECODER - NEP - lOZ - 2000 WORD SIMULATION 


NO. OF WORDS IN ERROR AFTER DECODING 


NO. OF WORDS 


DECODER TYPE: 


E 


ERRORS /WORD 


or more 


or more 


ED IN 

ERROR 

DCL; 

9 


li 

20 

15 

25 

li 

30 

21 

35 

1 



92 

163 

135 

318 

151 

151 

69 

203 

71 

232 

14 



191 

243 

138 

190 

116 

119 

52 

82 

44 

67 

21 



230 

235 

213 

228 

174 

168 

70 

130 

68 

88 

35 



274 

241 

233 

232 

187 

192 

116 

110 

86 

113 

57 



277 

215 

241 

224 

257 

256 

126 

190 

103 

124 

1872 



936 

903 

1040 

908 

1115 

1114 

1567 

1285 

1628 1376 

>R RATE 

IMPROVEMENT VERSUS 

TYPE DECX)DER - 

NEP ■ 

IZ - 

2000 W(»D 

SIMULATION 


1117 



1696 

1792 

1773 

1858 

1735 

1735 

1694 

1936 

1729 1964 

397 



213 

161 

150 

80 

123 

123 

U4 

11 

94 

13 

210 



64 

31 

56 

47 

30 

31 

65 

11 

75 

7 

129 



13 

5 

12 

6 

51 

53 

54 

4 

40 

6 

61 



11 

3 

6 

4 

54 

51 

29 

4 

13 

4 

86 



3 

2 

3 

5 

7 

7 

44 

14 

49 

6 


WORD ERROR RATE IMPROVEMENT VERSUS TYPE DECODER • NEP • O.IZ - 2000 WORD SIMOLATION 


or more 


1933 

35 

12 

8 

5 

7 


1977 1984 1985 1988 1979 1979 1978 2000 1973 1999 


21 

2 

0 

0 

0 


16 

0 

0 

0 

0 


14 

1 

0 

0 

0 


11 

1 

0 

0 

0 


9 

5 
1 

6 
0 


9 

5 
1 

6 
0 


9 

7 

1 

1 

4 


0 

0 

0 

0 

0 


11 

9 

2 

2 

3 


0 

0 

0 

0 

1 







TABLE 3.6 


2000 W080 SDOILATIOR FOR IZ AND O.IZ mnoB RATES 


ERROR PROB. 
OP 

DECODED SEC 

.68S93Z 
.5281 Z 
.9234 Z 
1.2421 Z 
1.1375 Z 

.0390 Z 
.0250 Z 
.07187 Z 
.082812Z 
.09218 Z 

.4250 Z 
. 3656 Z 
.9171 Z 
.2421 Z 
.1625 Z 

.02509 Z 
.0203 Z 
.0718 Z 
.00008 Z 
.00937SX 


PEOB. OP VARIOUS ERRORS PER DECODED WORD IH PERCEHT 


84.7999 

88.6499 
86.7499 
84.6999 
86.4499 

98.8499 

99.2499 

98.9499 

98.8999 

98.6499 

89.5999 

92.9000 
86. 7499 
97.7999 

98.1999 

99.2000 
99.3999 

98.9499 

100.0000 

99.9500 


10.6500 

7.5000 

6.1500 

5.7000 

4.7000 

1.0500 
.7000 
.4500 
.4500 
.5500 

8.0500 
4.0000 
6.1500 

.5500 

.6500 


.8000 

.5500 

.4500 

.0000 

.0000 


3.2000 

2.8000 

1.500 


.6500 

.6000 

2.5500 


3.2500 2.7000 
3.7500 2.0000 

.1000 .0000 

.0500 .0000 

.2500 .0500 

.3500 .0500 

.4500 .1000 

1.8500 .2500 

2.3500 .3000 

1.5500 2.6500 
.5500 .2000 

.3500 .3000 


.0000 .0000 

.0500 .0000 

.2500 .0500 

.0000 .0000 
.0000 .0000 


.5500 

.3000 

2.7000 

1.4500 

.6500 


.0000 

.0000 

.3000 

.0500 

.1000 

.1500 

.2000 

2.5500 

.2000 

.2000 


.0000 

.0000 

.3000 

.0000 

.0000 


5 or Morg 

.1500 

.1500 

.3500 

2.2000 

2.4500 


.0000 

.0000 

.0000 

.2000 

.1500 

.1000 

.2500 

.3500 

.7000 

i3000 




BER 



BER OF RECEIVED SEQUENCE 
Figure 3.11 
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Figure 3.13 










CHAPTER IV 


ALGEBRAIC DECODER FOR NONSYSTEMATIC CODES 
4.1 Introduction 

As mentioned In Chapter II, It Is highly desirable that decoding 
algorithms for nonsystematlc convolutional codes be developed. Since 
parity check matrices are difficult to form for this type of codes, 
an alternate approach must be taken. The method discussed In the 
following sections truncates the seml-lnflnlte generator matrix 
of a code to a submatrix G^ , called the subgenerator of the cor- 
responding code, such that its Inverse, i.e. G^^, exists. Thus, 
encoding is simply the postmultiplication of the message sequence by 
G and decoding, the postmultiplication of the received sequence by 
Gg"^ , i.e. Yg - and = Y^G^"^ where X^ and Y^ are the 

message sequence and the received sequence truncated to segments of 
length equal to the order of G^. Obviously, this decoding method 
works well only when the channel is quiet; it does not provide any 

error protection for the messeges sent# 

However, due to the structural properties of the generator 
matrix G^ , the order of the subgenerator G^ can be made an inte- 
gral multiple of both a and n . This means that if only one block 
of the message and the received sequence is replaced and multiplied, 
together with several previous blocks, by their respective multi- 
pliers, G and G , at each encoding and decoding operation, 
multiple parity checks can be provided. This is the basic idea for 
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the decoding of nonsystematic convolutional codes. 

As shown in Chapter II the basic building blocks of the semi- 

infinite generator matrix of a systematic convolutional code are the 

r + 1 submatrices, Gq, G^, .... Gp , where each G^ is an A x n 

matrix. This is still true for a nonsystematic code except that these 

G^ s do not contain an identity matrix or a zero matrix of order I . 

Obviously, the minimal requirement of the subgenerator G^ is that 

it must be a nonsingular matrix of order 6n or a nonsquare matrix 

of full rank containing all the F 1 submatrices, where « is an 

integral multiple of £ . Additional requirements are derived from 

the consideration of the encoding and decoding of the first block. 

Boyd^*^ has been able to show that 6 ^ and v nonzero rows 

must be prefixed to prior to truncation. The conditions for the 

^ 0 

of G can be suimnarizcci as follows* 
s 

V 

1. G must have at least 6n columns where 6 ^ . 

s 

2* rank {Gq} must be i . 

3. p must equal v . 

y is the number of the memory elements required in the minimal 
realization of the encoder and v , in the obvious realization of 
the encoder. The concept of obvious realization and minimal reali- 
zation of an encoder vill be illustrated In the next section with ait 
example. It is of interest to note that v « k - f *= Tfi, ; where k 
is the so called encoder's constraint length, obviously k - (F + 1)£. 

To keep the hardware complexity to a minimum, it is desirable 
to find a subgenerator of minimal size which is called the minimal 
subgenerator, designated as G^ . The inverse of is called the 


deslgnaMi aa of' . Oaca Oj ' la obtalnad, 
t.e dacodlng procea. bec»a. fairly al^pla. «>. re«l«d a.,a«.c 

p. .Mfted inro » <«-» ““ '**• 

. Mrs. ar a ri». Alrar each .lacK la »c.rad !«. the Input ahm 
regiater, the estimated encoder Inputs, X . ate fot«d by (Sl^ 

(6 + ni mod-2 addera and a connection matrix equal to 0^ 

that X - ro . FIS. Ohvloualy. d . r hloch. of Input data 

„e eatlmated by each decoding operation «.d only d operation, are 
participated In by each received bloch. Thla leave, et le«i. 1 
callable operation lor error correction if the burnt length U not 
aaar r blochs in a span ol 1 . d bloch. of the received aequence. 
„»avar. the s»st dillicult problem ia the actual identilication ol 

tbe reliable operation or operations should «. error event occur. 

n *.4 « A are directed to this problem. 

Most of the discussions in Sectio 

42 Physical RealUaflgl Sl CoBV°lHtl2!al. SS£Sders 

The parameters u and v mentioned in the last section c«. 

aecve aa measures of the complexity of a convolutional encoder. It 
is hnovn that any v - h-i rove in the generator matrix can at most 
span a u dimensional space, where „ , V with equality holds wh»i 
Che code is nonsystematic. Physically v represents the total 
nn^er of memory elements in the obviou. realisation of the encoder. 
Since it is »st lihely that a systematic coder can be further 

realisation ia designated a u • Another interpretation of V »d 

„ is that u - log, <■«“*« O' " 


l._.k I: i J . I - I- I I i I - J J I ' ‘ ' ' ' 
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at time t or later, given that the inputs at time t ot later are 
all zeros. The number of output states is less than or equal to the 

number of internal states • 

It is hoped that the following example may clear some of the 
doubts. Consider a (3,2) systematic code generated by the following 

subgenerators. 

g(i,i) - tgo(i.l). gzCl.Dl - (1 1 1) 

g(2,l) - [go(2,D. gi(2.1), 82 ( 2 . 1)1 - (1 0 1) 


A matrix formulation is achieved from the siibgenerators through 
use of some auxiliary functions^! in the following manner: 


[s-a.i)' 


T 


gj(l.l) 


'l' 


'g^d.l)' 


1 


m 


Pi ■ 


Si 


^2 “ 

82 ( 2 , 1 ) 

m 


go (2.1) 



1 

gl(2,l) 


0 



1 


l_ 





- 




iH 

1“ 

= tiJ[pjl0HP.l[0][p 1- 

7i 0 i\ /o 0 i\ /o 0 iV 

Lg(2). 

X« W ^ 

\o 1 i/\o 0 o/\o 0 1 /. 


[G 


0 ’ 


SI 



®2l 


®22 * 2 ^ 


and the generator matrix may be written as 



00 


I 

The parity check matrix may be written using auxllllary functions as 
follows : 


and 


then, 


H 


^0 

T 

m 

[1 

11 


r _ 

[1 01 1 

T 

- 

[1 

11 




«o' 






r T 1 

^0 In -1 


1 

1 

1 




- 




- 

T 

I 

as 

1 

0 

0 



«2 




hl 


T 

^ In-l 


1 

1 

0 













4 







< 










3 ° 

0 

0 



where 


Ho 

- 

11 

1 

11 

H 

1 »o 

0 

0 





Hi 

- 

[1 

0 

0 ] 








H„ - 

H, 

_ 

[1 

1 

01 

H 

2 »i 

«0 

0 




r 

2 






H2 Hi Hq 
4 - 


In order to see the physical significance of G and H, It Is 
more convenient to express them In terms of the Huffman delay 
operatorJ° D , which signifies a time delay of one unit. Thus, If 
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x\ signifies the first input of block i , then D Xj signifies 

V, U 4 9 < e the block previous 

the first input bit of block i - » . i.e. ttie 

to block i . The formula for the transformation is 


G(D) - 


g\(d). 

G^(D) (^(D) 

gJ(D), 

e 

G^(D). .... g5(D) 

s 

• 

G^^j^(D) . . . . . 

X(D) - 

[X^D). x2(D). ...i 


1-1 i 


where 


C^(D) 


+ ... + D^8?t ** “ 1,2.... n 

8ql + ° ^ ^2L TL 


3^(D) - Xq + + d2x2 + ... + 0% 


Ij • 1.2....n"l . 


and 

H(D) * [H^(D), h2(D), ... H (D)1 

N, V uN X nlh^ + + D V for N- 1 . 2 ,... n 

where h"(D) - hj, + D^h^ + ... + B Uj. 

Using the D operator the code can be written as 

y(D) - x(D)G(D) and G(D) H(D) - 0 

By employing the D operator, the example code can be trans- 


formed as follows: 







°o - 


*01 


85 l « 0 l 


8 o 2 8 q 2 *02 


10 1 
Oil 


» ®l 


8 ll «ll 


«1 g 3 

*12 *12 *12 
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0 0 1 
0 0 0 



g^ 

21 

g^ ' 
21 


— 1 

O 

0 

1 

*« 

*22 

CM 
CO CM 
00 



0 

1 


gJ(D) - gJi + D g|i + D^gJi " *01 ® *11 ■*“ ^^21 

- 1 + 0+0 - 1 - 0 + 0+0 - 0 


g 3(D) - g^, + 0 g?i + 0^*1 


»01 ~ '*11 
- 1 + D + 


21 


gJ(d) 


- g 


1 + D 


02 "12 22 
0 + 0 + 0 • 0 


g 2 ( D ) • g ?2 + D *12 •*• °^*2 


22 


1 + 0 + 0 ■ 1 


g 3 ( D ) 


■ e?a ■" “ 'k ^ 
- 1 + 0 + 


and 

H 




[1 1 11 


0 

h 1(D) - hj + D h[ + 

- 1 + D + 


^ - IhJ . h^.hJl -[ 100 ] 

H2(D) - hj + D hj + I)2h| 

- 1 + 


- [hj,h2,h|l - [1 1 01 

'I 


-2 .-» 2 . n 2 »" 2 J 

H3(D) - hj + D hj + D^hl 


1 


therefore 


G(D) - 

GJ(D) 

Cj(D) 

gJ(d) 


* 1 0 1 + D + d2 ■ 


gJ(d) 

m 

G^(D) 

g|(d) 


_ 0 1 1 + d2 

H(D) - 

[h1(d) 

h2(d) 

h3(D)J 

m 

[1 + D + d2 1 + D 


By using the equation y(D) - x(D)G(D) , It can be obtained that 

Fl 0 I + D + D^l 


tYl Y2 yj] 



1 


1 + d2 


- [x^ x^ (1 + D + d2)Xj + (1 + D2)x2] 

• [x^ Xjj (x^ + x^) + D Xj + d2(xj + X2>] . 


Therefore the obvious realization for the encoder is shown in Fig, 4.1. 



X2 

(Xj + X2>+ DXj 
+ d2(Xj + X 2 ) 


Fig. 4.1 Obvious encoder realization 
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c 


From Fig. 4. 1 It can be seen that 


- the length of the first shift register, or 
the first constraint length 

- max {deg[G^(D)]} - max{deg[Gj(D) , g2(D) ,G^(D) ]} 

1 1 J 1 3 

« max{deg[l, 0, 1 + D + D^]} ■ 2 


■ max{deg(0, 1, 1 + D^]} - 2 

The overall constraint length v is given by v ■ f '*2 ’ 

1«1 ^ 

4 ; therefore, the encoder has 2^ * 2*^ * 16 internal states. A 
detailed study of this circuit indicates that there are only 4 2^ 

distinct output states; therefore, this encoder can be simpllrled 
using only p ~ 2 memory elements. An encoder using the minimum 
possible number (y) of memory elements is called a minimal realiza- 
tion. The minimal realization of the example code is 



memory 

elei&ant 


the no. of memory 
demands in the 
minimum realization 
* 2, while the no. 
of memory elements 
for the obvious 
realization » v ■ 4 


Fig. 4.2 Minimal encoder realization . 



As pointed out earlier, p < v la a typical phenomenon for the 
systematic codes and there are only p linearly Independent rows 
among any v rows In the generator matrix G . This Implies that 
the subgenerator Is generally singular or does not have full 
rank for systematic codes. Therefore, the proposed algebraic decoding 
does not apply directly to this class of codes unless their generator 
matrices are simplified according to their minimal realization. The 
applicability of the proposed decoding method to systematic codes 
needs further investigation. Since nonsystematic codes are generally 
superior to systematic codes, this problem will not be pursued any 
further in this work. 


4.3 Algebraic Decoding of Nonsystematic Codes 


Derivation ^ tj^ Minimal Subgenerator and Its In>yerse 
Since the first block of Y depends on the present block and 
the previous T blocks of X , then v - Pi nonzero rov?s must be 
prefixed to G prior to trurcating it into the minimal subgenerator 
Gg . This, in turn, requires the input sequence X to be prefixed 
by V - Pi 5.1 ■ zero bits. 

Consider the Paaske's (3,2) , v ■ 4 code whose P + 1 sub- 
matrices are 


G 


0 


10 1 
Oil 


10 0 
10 1 



1 1 0 

oil 


This code has p ■ 4 « u and the rank of G^ is 2 ■ £ ; 
apparently it does not violate the conditions of having a minimal 


S lata. The order of r 

..tl.fy » . J„ w , , « of G, «»t 

^ n-£ - (3^)0) - 12 . 

^nerally g, may not ha 

6 y not be a square matrix- q 4 

"atrlx only when v ti, 3. Int , • 6 is a square 

1" ‘ — 

«■- --e, «a ,, 

columns and (u + 

.« e,ual »ly 

^5 is a square matrix, 
for the Peaske'e (3.2, . „ . , 


r blocks 
V bit! 
prefix 




r ^ columns - j 

^ ^ “ » 0 0 000 000 ) 
“00 000 oooj 

^fo 000 oooj 
^ I ^ ° G ^ ° “ oooj 

0 oWl X o\ 0 0 0 


^ 0 xAo X xy 0 0 0 

° ° ^ ^ f 0 0 X X „ 

' “ “ “ Off I 0 X 02, 

° ° ° ” » 0 X 0 X X 0 0 

° “ “ 0 0 0 X X X 0 X 

0 0 0 0 0 0 0 0 0 X 0 1 

° 0 0 0 0 0 0 0 0 0 X X 


6 £ + V 


Then g‘^ Is 
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10 1 
0 0 1 
0 1 1 
0 0 0 
loo 
0 1 0 
0 1 0 
loo 
10 0 
1 1 0 
1 1 0 
1 1 0 


10 10 
10 10 
1 0 1 0 
110 0 
Olio 
1 1 1 0 
0 0 11 
1 0 1 1 
10 11 
10 0 0 
10 0 0 
10 0 0 


s 


0 0 110 
0 0 110 
0 0 110 
1 0 1 1 1 
1 0 0 0 1 
1 0 0 0 1 
0 0 10 1 
1 0 0 1 0 
1 0 1 0 0 
1 1 0 0 1 
1 1 0 1 0 
1 1 0 1 1 




and decoding we would perform x - r g“^ 

6 


4-3.2 to k. 7 

lo tottoUto the for the (2.1) k - 2 code 

have: 


Gq - 

[1 

11 

Gi - 

[1 

0] 

G 2 ■ 

[1 

1] 

G 3 

- [1 

1] 

m 

(8^ 

*01 

*0.' 

m 

K 


a 

f8^ 

21 

«2^^ 


“ [g^ 
31 

«31^ 





[0 

0] 

G 5 - 

[0 

1] 

Ge 

- [1 

1] 




m 

l»4j 

g2 1 

. 4K 

m 

[8^ 

‘*5) 



■ fg^ g2 1 
‘*61^61 ^ 

G}(D) 

" 8 


^11 

+ D2 

8^ + 
*21 

03gl 

*31 

+ D'*gl 
*41 

+ D® 

-f 

®51 

D^gl 

*61 


1 + -f d2 + 


D + 0 + 0 + D® 
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The minimal subgenerator matrix is: 


1 

0 


1 

1 

0 

1 

1 

0 




1 

0 


0 




1 

0 

0 

1 

1 

1 

1 


1 

1 

0 

1 

1 

0 

1 


1 

0 

0 

1 

1 

1 

1 


1 

1 

0 

1 

1 

0 

1 


0 

0 

1 

1 

1 

1 


In order for G 


1 

0 

1 

1 

0 

1 


j “tlie inverse of the nlnlmuni su||;ner.itor 


o 


must 


matrix-to exist, three conditions must If. satisfied: (1) 

have at least 6n columns, (2) v- must equal to v , (3) rank {G^} 
must be e. ° 

It has been shown that the P I) t = 7 j 

(.,1), k = 7 code under consideration 

satisfies ail these conditions. 

“Ith a computer program, using Gaussian elimination tedmique 
="<1 .od-2 arithmetic, it „as found that the desired Inverse is: 






o 


o 


.“I 



0 

1 

0 

1 

1 

0 

0 

1 

I 

0 

1 

1 


I 

1 

1 

1 

0 

1 

0 

I 

1 

0 

1 

1 


1 

1 

0 

1 

1 

1 

1 

0 

1 

0 

1 

1 


1 

1 

0 

1 

0 

1 

0 

0 

0 

1 

1 

1 


1 

1 

0 

1 

0 

1 

1 

0 

1 

1 

0 

0 


0 

0 

1 

1 

0 

1 

0 

1 

1 

0 

1 

1 


8 9 10 11 12 


1 

1 

1 

0 

1 

1 

1 


1 

1 

0 

1 

1 

0 

0 


0 0 


1 

0 

1 

1 


0 

1 

1 

1 


1 

1 

0 

1 

0 

1 

0 

1 

1 

1 

0 

0 


0 

0 

1 

1 

0 

1 

0 

1 

0 

1 

1 

1 


1 

1 

1 

0 

1 

1 

1 

0 

1 

0 

0 

0 


0 

0 

1 

1 

1 

0 

1 

1 

1 

0 

1 

0 
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for the example code. 


4.3.3 Error Detection and Correction 

With both and on hand, encoding becomea simply post-- 

multiplication of by G,. .-»nd decoding, poatmultipllcation of 

Before going through an example, a notation, , which 

signifies the estimated value for the bit In block 1 of the 

input seQuence x obtained front the decoder operation should 

be introduced. 

Assume that an encoder for the example code receives the 
following input sequence 


OllOllOllOll 
x^ x‘ 


X ■ 


“«*“• «q<»nc. would b. 
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rtf. 0 


ra bits 
prefix 


' ^ ^ ^ 10 00 01 01 oo 01 01 


,11 


procoss lo . 1 ^ 1 , ^ 

^-“Oer-o inpub „dlobo., o„. bloI.V.r'”' 

Olnuo Obo ooueoub. o, bbe oodl,., b, o- T’ 

“““““ ““ 01 lopo. dob. oud „ l; 

preuloua blocks r„ 'I"*’ o®*®”! 

- .®v®o;: opI::”""- - 1® ®®®i- 

0®velop«„bs, It 1 . thus ** '' 

® these repetitions which all ^ 

tion and correction. detec- 

The following table describes the 

the consequence of j 

operations. ^ decoder 

It is easy to see from Table 4 1 th ^ 

has been estimated d + r ti ' “ message block 

+ r estimat k *^1 the 

estimates should be i„ 

“a a clue for error detection. The i i ' 

each decoded bit with the ^ aPP^oach is to compare 

with the same decoded bit oh^t.d , 

decoder operation. If the two bits di the previous 

^Is is the error d assumed, 

error detection method, which ma . 

— - way Of parity checking. " ^ ^ 

According to a theorem developed h » 

»” - -®.vsd scusscs IS cbtslH d“7°^'’" • 

d from mod-2 addition of the 


If 


TAm.E 4.1 

A SEQUENCE OF DECODER OPERATIONS 


Decoder Coiuetus of Outmit of 

tetion 

I I 1 00 1 00 I on I nn I no I I t n ) n i t i » i .. i 


0 


00 

00 

00 

|oo 

00 

00 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 








r' 
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00 

00 

00 

00 


ii 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 
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F 

2 


00 

00 

00 

00 

T** 

n 

01 

01 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

3 


00 

00 

00 

n 

01 

0 

0 

0 

0 

0 

0 

0 

0 

0 

.s‘’ 

1 

1 

4 


00 

00 

11 

01 

01 

11 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

0 

5 


00 

n 

01 

01 

M 

10 

0 

0 

0 

0 


0 

i> 

1 

1 

0 

1 

6 
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01 j 

01 

li 

10 

|oo 

0 

0 

0 

i 

0 

1 

0 

0 

1 

’ 1 

0 

1 

1 

' 1 

7 


01 

01 

n 

10 

00 

01 

0 

0 

0 

0 

0 

1 

1 

0 

1 

1 

0 

a 


01 

11 

10 

00 

01 

01 

1 

0 

0 

0 

1 

1 

0 

1 

1 

0 

1 

9 


11 

10 

00 

01 

01 

00 

0 

0 

0 

1 

1 

0 

1 

1 

0 

1 

1 

10 


10 

00 

01 

01 

00 

01 

0 

0 

1 

1 

0 

1 

1 

0 

1 

1 

0 

n 


00 

01 

in 

Oi] 
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o\ 

0^ 

1 

1 

0 

1 

1 

0 

L 

1 

Ff; 

0 




j 

r ' 

. |: 


,10 

,n| 

x*" s 

' iriv 





\\^\ ; 
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output associated with column K for one decoder operation and the 
output associated with column 5 - i for the next operation, pro- 
viding column 5 is one of the last (6 - 1) i columns of g"^ and 
is nonzero in at least one of its first n positions. 

For the example code C shall be chosen from the last (6 - 1)1 

- 5 columns of such that its first n - 2 positions are not 

0 

all zeros. Column 11 of g"^ fits, the theorem and thus the exis- 
tence of errors can be detected by mod-2 addition of the estimate 
associated with col. 10, l.e. C - 1 , with the estimate associated 
with col. 11, i.e. 5 t obtained from the previous operation. The 
result of this comparison is appended to the syndrome sequence. An 
all zero syndrome indicates that no channel errors have occurred. 

Since one block of the input data has been estimated by several 
decoding operations, error corrections can be achieved by replacing 
the estimate obtained from the erroneous block with any estimate for 
the same bit which did nut require the use of that block. 

It has been shown that a message block j , say x , will be 
estimated 6 + T times; however, an error in r^ can only propagate 
6-1 times. This fact Indicates that operation 1 may be used to 
correct an error in block j , say , as long as J + « 1 1 < 

J + 6 + r . 

The present approach is to use the syndrome sequence to signal 
the beginning of an error rather than to identify an error pattern. 
When an error starts, beginning with that block, the next 6-1 
blocks of estimate must not be used for error correction as error 
effects are still contained in these estimates. The r estimates 
following the 6-1 estimates are supposed to be error free 
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providing that succaasiva erroneous blocks are not closer than 
6 r - 1 blocks, 1,6. a guard space of 6 + T - 1 blocka are re- 
quired. This is to safeguard the estimates for block j obtained 
from operations J + 6 to j + 6 + r - 1 are not corrupted by other 
erroneous received blocks having direct effects on this interval. 

Since an error in the , may not cause a ”1" immediately for 
the syndrome bit associated with that operation, i.e. s^ may not be 
"!'* , a method must be devised to keep track of the beginning of a 
syndrome even if the first few syndrome bits are zeros. 

k list of all the possible error patterns in one received block 
and their associated syndrome sequences is given in the following 
table. 


Event 

Error Pattern 
in Block j 

s^ 

sJ+l 

sJ^2 

Syndrome 

.J+3 .3+* 


sJ-^' 

A 


0 

1 

1 

1 

1 

1 

0 

0 

1 

0 ... 

B 


1 

0 

1 

0 

1 

1 

0 

1 

1 

0 ... 

C 


1 

1 

0 

1 

0 

0 

0 

1 

0 

0 ... 

The 

syndromes 

are listed 

to the 

point 

where 

the e 

f fects 

of the errors 


have ended. 

From the above table, it Is clear that when the first "1" 
appears in a syndrome sequence, errors may have already propagated 
several blocks. For instance, for event C , the earliest possible 
error indicated by s® - 1 has J - -1 which means that an error in 
block r~' shows its nonzero syndrome hit after receiving block r° . 
This Implies that this error can be corrected by operation I where 
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+ + r , or » 

»hll. bath .vent. K mi B h.v. .» - 1 vtth 3 - 0 . ».»aln« they 
can b® corrected by operation 1* where b i X <12 . 

In order to distinguish the various error patterns that require 
different correction timing since the first appearance of the nontero 
syndrome, it seems that the entire syndrome sequences have to be used 
A second look shows that this is not so. As can be seen easily froiiL 
the syndrome table, if the first two syndrome bits are 11, event A 
is uniquely identified. If the first two bits are 10, correct identl 
flcation of error events depends on one more syndrome bit; if the 
third bit 1s a "1”, even^ B is the error; if a "0", event C is the 
one. A systematic way of doing this is to draw a "syndrome tree" as 
shown in Fig. 4.4. The tree stops at the point where each branch 
correspoitds to only one possible error event. (The irotation C ' 
signifies error pattern C in block r”' ). Events with the same 
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-1 s «re grouped together end a syndrome sequence shall be recorded 
to the point that each group can be uniquely identified. For the 
example code* 

8® 8^ S^ 8® S** 8® 8® 

8»100--- correct and reset s - group 1 

correct and reset s - group 2 

where indicates "don't care". One way to Implement this algo- 
rithm is to use the following circuitry to match the syndrome 
sequences obtained above for each group of error events so that a 

"1" will be produced to signal the correct timing for error cor- 
rection. 



4*5 SyndronK? search logic* 

The decoder consists of a connection nuttrlx which corresponds 
to ,n (.S ■■ 1) -stages input reglstei-s. (v + Oic) mod 2 adders. 

« (v + - 1 ) - stage output registers and a syndrome search logic 
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«• thown In Fig* A. 5. 

Decoding «« fellow# » the received sequence le 

•hifted into the input register# one block #t « tlwe. After e*ch 

block l« entered Into the Input register, the estlwsted encoder 

inputs xj sve forced by the (v’it v) mod 2 adder# and the connec- 
* ^ 
tim matrix. '0x4# action Is equivalent to performing x • S . 

If there are xxo erroneous received bits, the estimates will be exact, 
i.e. X • X , and the snydnxwe bit that corresponds to that block 
will be aero. However, If the i-eoeived block la In error, beginning 
from that operation and lasting through the xxext (.'i » 0 operatloxvs, 
the estlwxates for that block will be unt'eHable. Under the con- 
dition that the following + r - I input block# ax-e all clean, 
estimates for that block obtained from the next r operations are 
correct. The tracking of the errors Is taken care of by the syndrv'me 
search logic. If channel ert\>vs cause iucorrect estimates to eniei 
the output shift register, the condition Is Indicated by a >uM\aerv> 
syndrome and the ertHMxeoxts estimates are replaced by other estimates 
via the traxxsfer gates as soon as corr-'Ct estimates are obtainable, 
I.e. when the syndrome search logic prodxices a *T' outjnxt, and the 
syndroew register is reset to aero to restart another search. 

Fig. A. 5. 

A. 3. A NodJXie_d Al^eb l^i:.'ldex 

11, e abow prop, wed decoding method works well when bursts aiw 
separated by eiunmh envr tree blocks; Its estimates are unreliable 
If the ,'hannel Is not so ben,’Volent . Hxts motivates cms I .let at Ion 

4 hyl'riil I i\ji s4V!*tc'uw 
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Since the checking of the guard apace la the main Issue, It Is 
necessary to know when an error starts. One way of achieving this 
purpose Is to re-encode the estimated sequence and compare It with 
the received sequence, block by block. Wlienever the two sequences do 
not agree, that block Is considered to contain an error. Since 6 
error free blocks are required, as soon as an error Is detected, the 
next 6 blocks are examined. If they all agree, the decoder assumes 
an error free guard space was received, which would imply that the 
dXOT was properly corrected. If the next 6 blocks do not agree, 
the decoder estimates will be regarded as unreliable and a second 
algorithm will have to be used. Since the algebraic decoder is a 
good burst corrector and requires an error free guard space of finite 
length, the second algorithm would be most likely a random error 
corrector and hence would not require error-free guard space; in 
particular, the maximum likelihood probabilistic decider, namely, the 
Viterbi decoder is proposed as the second phase of the hybrid system. 

Additional hardware includes an extra encoder to re-encode the 
estimated sequence, n mod-2 adders to compare the re-encoded sequence 
with the received sequence and a flag logic to check the violation of 
guard space requirement. Whenever the outputs of the second encoder 
differ from the received sequence for a certain block, an "1" enters 
the flag logic; after it propagates 6 times, a flag will be set. 

If there are no differences between the re-encoded sequence and the 
received sequence in the guard space, indicated by an all zero flag 
register, the flag is reset to zero and the estimate of chat block is 
regarded as correct. A flagged decoder estimate is considered to be 
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algebraic decoder works well only for the correction of short bursts 
where the burst corrections can be made definite. 

More will be said about the hybrid system and several alterna- 
tives will be presented in the next chapter. 

A. 3. 5 Probabilistic Decoding of Long Bursts 

So far discussion has been limited to the correction of short 

bursts of one block. The definitions of "long bursts" or "short 

bursts" are nut intended to be rigorous, those bursts that can be 

stored In a decoding table or Incorporated into the syndrome search 

logic so that their decodings can be made definite may be defined as 

short bursts; otherwise, as long bursts. Hierefore short bursts can 

be regarded as bursts of one to two blocks. As pointed out earlier, 

the multiple parity check encoding allows one source block to be 

decoded (P + iS) times while only 5 received blocks are required for 

each decoding operation. Tliis means that if one received block is in 

error, there are r chances to recover the source sequence, i.e. if 
J th 

r is in error, the i'“” estimate can be used for correction as long 

as J + 6 ^ I < j + 5 + r . With each additional block of the burst 
length, the chances diminish one. H'o re fore, the entire source se- 
quence of (r + bits is still recoverable as long as the burst 
length does not exceed V blocks. Thus, V consecutive bursty 
blocks, beginning at the block, could be corrected by the 
(J + 5 + r - 1)^^ estimate, providing that the folliiwing received 
blocks, i.e. r^^^ to ^ blocks, are all error free. The 

potential burst correcting capability of the algebraic decoder is 
that a burst of length 1* blocks Ciin be corrected as long iis it is 
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TAB1.E 4.2 

decoder OPERATTONi: IN THE PRESENCE OF A LONG Bl'RST 


1 


Sourco sequonco: C 1 i n i i ^ 

Code scquonci'; 00 lirnm lOj 

Error s^iuenci-: )i n jj j. JJ 00 01 01 

Rocelvi'd scqiK-iuc; H OO 10 10 nn n 

Docodod soquoMc-c: 0 1 f n °? "t' 01 01 


1 1 


1 1 0 1 


Decoder 
Ope rot ion 


Content of 


0 

00 

00 

1 00 

j 00 
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00 

00 

00 

00 

2 

00 

1 00 ; 

00 

11 





r ** 

3 

00 

00 

n 

00 

4 1 

0(1 

11 

1 

00 

' 10 

i 


1 

00 1 

10 

1 

U) 1 


LM- (r) 



Output of 
Med-J* AJvIer (\) 

0 1 0 1 0 i 0 1 0 ! 0 j t) I 0 I 0 i I 

i ! ! ! ! I I? 

on I ! j 1 1 0 1 1 

X" /X ’ 


^ P M M p M j ^ j M jo 
^ ( ' 1 1 I > !o j 0 ! 1 jo io I 


' I ' * ■ ' ! 0 ; 0 ! 1 ; 0 ; 0 '0 

( I f I I i I ! i 

I j I j 1 I 0 i 0 i 1 1 0 

1 1 0 1 1 ; ] 1 

Mm 

0 I (» ; 0 ; 0 ; I 


I 

] ! 0 


f 


J io !0 I 


1 j 1 j 0 j 1 I 1 I 0 1 1 
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followed l»«dl.t.ly by . cl«„ ,„.rt ,p„. j 

Of guard apace required to the maUau. burnt length correctable la 
aiapl, d/r . Fnc the axaaple (2.1). k - 7 cod. conaldered. thl, 
ratio 1. 1, therelore. It obvloualy outperform the Wyner-Aab'e 
codes and is justified as an optimal B2 code. 

correction of long bursts cannot be made definite because of the 
large number of syndrome patterns involved. However, tlie long bursts 
may still be decoded with high probability of being correct by ex- 
tracting the general characteristics of the ensemble of syndrome 
patterns. One method of decoding long bursts is to examine the syn- 
drome sequence to see if a certain length of consecutive zeros can be 
obtained. As soon as this pre-established criterion is satisfied, 
the decoder retracks to the operation prior to the appearance of the 
Irst zero and replaces the estimates of that operation for the 
previous (r + 6) decoded blocks. Hiis requires a buffer register 
to store the estimated (r + 5) blocks decoded bits at each step and 
constantly replaces the contents of the buffer register with the 
current estimates unless the syndrome bit at that step is zero. This 
decoding method does not always catdi the bursts in time; first, the 
criterion is difficult to establish; if it is made too tight, an 
Incorrect estimation may be mistaken as the correct one. If it is 
made too loose, correct timing may be missed and a large number of 
correctable bursts may be left uncorrected. One favorable feature of 
this method is that, if the clean guard space is long enough, l.e. 
longer than (5 + z) blocks, where z is the length of the pre- 
established all zero syndrome sequence that has to be checked, not 
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only can most of the long bursts be corrected but most of the longer 
bursts, regardless of how long they are, can be partially corrected, 
i.e. at least the last r blocks of most longer bursts can be cor- 
corrected. 

4.4 Error Bound and Characteristics of the Decoder 

Calculation of error bound is extremely difficult due to the 
large number of error patterns that could be decoded probabilisti- 
cally. However, in order to provide some indication of the perform- 
ance of the decoder, a rough estimate is attempted which could be a 

v®iy loose inessure of its capshility* 

Since the proposed decoder is capable of correcting all short 
bursts of one to two blocks definitely, with some capability for 
longer bursts of any length, the overall error probability should be 
upper bounded by the probability of getting bursts longer than 2 

blocks. 

Let p be the channel error rate. Then q = 1 - p would be 
the probability of any one bit. being received correctly. A long 
burst can be viewed as a short burst whose guard space contains at 
least one erroneous bit. The probability of such events is 
?(i) ■ (1 - q**)(l “ • An incorrect decoding will output 12 

uncertain bits; if assuming random binary values for each bit, only 
half of them could be decoded Incorrectly. Thus, the overall bit 
error probability is upper bounded by 

P(E) 1 Y ~ ’ 


101 


Clearly* this Is a very loose bound, since it is assumed that none 
of the long bursts can be corrected. Of course* this is not true 
with the present algorithm. 

The circuit of the entire decoder was given in Fig. 4.7. It is 
quite simple. Parts count is around 4 times the number of rows* with 
the addition of two buffer registers if long bursts are to be cor- 
rected— one for the storage of outputs for later retrieval and one 
for temporarily holding the contents of the transfer gate for later 

use. 

The decoder operates quickly if only bursts of one to two blocks 
are stored in the table* or incorporated in the syndrome search logic 
for definite decoding. For long bursts correction, after an initial 
delay of a few blocks, which is compatible with the requirement of 
the Viterbl decoder, the rest of the decodings are in real time and 

no real disadvantages will result. 

Since is of finite size, error propagation can be greatly 

6 

suppressed. For the example code, the error effect of any received 
block cannot propagate to more than 6-6 consecutive operations 
from the time it enters the decoder. This is a great advantage of 
the algebraic decoder over the probabilistic algorithms. 

As mentioned in Sec. 2.4, the Wyner-Ash criterion of optimal 

82 code is 

length of guard apace ^ n t 

length of longest burst correctable n - i 

For the (2,1), k - 7 example code, the ratio is 3. Since this code 
is capable of correcting bursts of 4 bits when a guard space of 12 
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Figure 4.7 Errot-Correciing Pacoder. 



103 


is given. It satisfies the i. 

■=™sl-«.d thst this cole is 1.1s V’' 

P'^opossl lecoler Is fmi " “™««r 

cepshiiic. Wh« 

optlnnl hutst cottsctot iT^tT^ 

cottsctln, cole"'7™ “ 

-iShlv lihslp thst the ptops , ■ '>«•« io™i It to 

::rr ;•“■"“• ■“•■■' 

."IT," "■ •' “ V....T ■; ■'•'■ 

sssn fton ,^sr-gsh's to„„i. „ „ f''' <=sn 

«iuxa cftat for f-fvo^ n 
onstralnt length of the coder th i ^ 

««sd; hovevet, the gnsrl so ’ ' 

e rd space required in^ 

urthemore. the larger the r Proportionally. 

We the algorithm; l.e. there ar '' '' ’ "«ss ilexl- 

'-iectlons. Therefore 1 

---"-won 

‘Wo« o sool ranlom error correctr"^" 


^onclua<rm 

goal of develon^ 

veioplng an algebriH/v j 

-Oiied to nonsvstamatle coles 7^ ^ 

this chapter. ‘»«en achieved in 

It has been shown that thl« i 

well for thp * fiebralc decoder perfonr 

r the example (2 1) ^ y Performs extremely 

-WOS Short harsts of Jne 7 1. ,77 ^i"! ^ “'■ 

“0 — Of scheme la „.si. ,, ^ “ » ‘shle looh- 

V ‘Wt even long hnrsts op to^t?" 

-oc s can be corrected with 




104 


high probability of success. Corrections of bursts longer than 6 
blocks are limited to their last 6 blocks. The only requirement is 
that 6 blocks of clean guard space must follow immediately after the 
short bursts with somewhat longer space for the long bursts. If the 
syndrome table can be made to include all the burst patterns, 6 blocks 
of guard space would be all that is needed for any bursts, long or 
short. The relative short guai'd space required as compared to its 
burst error correcting o.sp.abllity justifies the (2,1), k - 7 code as 
an optimal B2 corrector In the sense of t!ie Wyner-Ash criterion. 

The conclusion, then, is that If methods could be provided to 
remove random errors prior to the application of the algebraic 
decoder, the ch,ance of burst error corrections would be greatly im- 
proved as the duance of acquiring clean guard space is Increased. 

Tl\l8 will be the topic ol the nest chapter. 


CHAPTER V 


HYBRID DECODER 


5.1 Philosophy 

Although the algebraic decoder has the potential of correcting 
any bursts of length F blocks or less in a T + 6 block's span of 
incoming data stream, the number of distinct syndrome patterns that 
have to be identified forbids such attempts for large r . With the 
innovation of new memory devices such as magnetic-bubble memories, 
however, such large memory requirements may not be impossible in the 
future. 

Unlike the concatenated codes, the proposed coding scheme employs 
only one code, an optimal d£j.gg convolutional code, with a two 
phase decoding process. The interfacing of the two phases is quite 
flexible. Various probabilistic decoding algorithms can be selected 
as the second phase and different Interfacing methods can be employed 
to fit the particular channel characteristics and the user's needs. 

Previously, an attempt has been made to use the algebraic decoder 
to carry the main load, the Viterbi decoder coming into help only 
when the desired error-free guard space does not exist. This scheme 
has the advantage of being fast and causing relatively short decoding 
delay. However, if long bursts--!. e., bursts which have not been 
designed into the syndrome search logic to be identified— are encoun- 
tered, the hybrid system will lose synchronization and errors will 
propagate. Study of the performance of the Viterbi decoder in Chapter 


j>KtGfO»l4G 
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III reveals that this decoding algorlthpt Is also capable of correcting 
short bursts^ l«e., bursts of two blocks or less* Therefore, It can 
be concluded that both the algebraic algorithm and the Vlterbl 
algorithm are capable of correcting random errors and short bursts, 
but the latter do not require error-free guard space. It Is the 
ability of the two algorithms to handle long bursts that needs our 
attention. In the Vlterbl decoder, which Is optimal In the sense 
that It utilizes the entire distance between codewords available from 
the encoder, error propagation Is much more prominent than In the 
algebraic decoder, which bases Its decoding decision on the trun- 
cated data stream. The superiority of the Vlterbl decoder in hand- 
ling random errors and short hursts and the complementary nature of 
the algebraic decoder and the Vlterbl decoder when encountering long 
bursts, motivated the development of an alternative hybrid decoding 
system that possesses the same error-correcting capability as the 
Vlterbl decoder during random errors and short bursts but can sup- 
press error propagation effects as well as the algebraic decoder. 

In order to achieve such a system, methods must be developed to 
switch the decoding load back and forth between the two decoders 
according to the channel property at the moment. If the channel Is 
clean or has random errors or short bursts, the decoding duty Is 
allocated to the Vlterbl decoder. If the channel encounters a long 
burst, as soon as it is certain that the burst is over, the load Is 
shifted to the algebraic decoder for the next 72 bits duration. When 
the hybrid system is operating in the algebraic mode, should another 
long burst error occur, that mode Is terminated immediately and a 
shift is made back to the Vlterbl decoder. In this manner, no 
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error-correcting duty Is allocated to the algebraic decoder; it Is 
used only to identify the syndrome sequence and as a subsidiary 
decoding device during the resynchronlzatton period of the Viterbl 
decoder. As pointed out earlier, the algebraic decoder Is not capa- 
ble of correcting any error that Is not correctable by the Viterbl 
decoder but the latter does have a much longer decoding delay than 
the former. Thus, to let the algebraic decoder take over the duty 
only after the long burst is over seems a logical choice. 

A flow diagram will depi.ct the overall concept and the hybrid 
decoding procedure much more clearly, Fig. S.l. 

5.2 Algorithms 

5.2.1 Syndrome Detecting Logic 

For the alternative hybrid decoding system, syndrome detecting 
Instead of syndrome searching becomes the main theme. As Indicated 
in the flow diagram, the hybrid system must be able to detect the 
beginning and the ending of a burst and to distinguish the long bursts 
from the short bursts. One possible Implementation of the syndrome 
detecting logic Is shown In Fig. 5.2. 

The syndrome detecting logic so designed will produce a "1" If, 
and only If, when a long burst Is over, It stays at "1" for the next 
36 operations unless encountering another error which will terminate 
the algebraic mode prematurely. Thus, the hybrid algorithm will be 
such that If the syndrome detecting logic output is "0", the Viterbl 
decoder will be employed; otherwise, the algebraic decoder will be 
employed. 
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Kl»5vire Hybrid Dwcoviln* Flow Chart 
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The development of the syndrome detecting logic is quite compli* 
catedf especially the syndrome search portion which involves the 
listing of all distinct syndrome patterns for short bursts and the 
forming of a syndrome tree. The purpose of the syndrome tree is to 
eliminate all the redundant bits of the syndrome sequences under con- 
sideration so that a simpler logic system can be made. Further simp- 
lification or combination of the "NOR" gates is possible by the "prime 
implicant table" method. 

5.2.2 Syndrom e Detecting Logic Development Procedure 

The function of the syndrome detecting logic, S.D.L., is to 
detect long bursts which are not correctable by the Viterbl decoder 
and to allocate the decoding duty to the algebraic decoder so that 
error propagation can be confined to the latter. 

The heart of the S.D.L. is the syndrome search logic S.S.L., 
which identifies specific short bursts, should a bursty event occur, 
therefore allowing recognition of longer bursts not individually 
recognized. 

The first step toward the development of the svnndrome search 
logic is to list all the possible syndrome patterns caused by the 
short bursts. The best way to achieve this is to use a computer pro- 
gram that simulates the syndrome calculator and tabulate the error 
vectors and their associated syndrome patterns in the output. 

Table 5.1 is a list of the syndrome patterns of the short 
bursts, i.e. bursts confined to within two blocks, for the example 


code. 


U1 


TABLE 5.1 


LIST OF THE SYNDROME PATTERNS OF THE SHORT BURSTS 
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As »ay be noticed, the first nontero digit of the syndrome 
..,«nce msy not eppesr l^edl.tely sfter the receipt of erroneous 
hloch, that is. there may he a delay of se«ral Input hlodcs before 

the first appearance of an "1" In the syndrome sequence. This effect 

d«e-. ^ sa sittnifles error pattern J 

is designated by a superscript, i.e. J sig 

in block r-’ . The superscript "O" will he dropped. I.e. A - A». 

in Chapter IV the use of a syndrome tree to eliminate some of 
the redundant syndrome hits has been mentioned. While It Is legltl- 
„te to do so If the purpose Is to distinguish one short burst from 
the others, this simplification Is not valid If the purpose Is to 
abstract the short bursts from all the possible bursts, long and 
short, on the contrary, the number of hits to be examined must be 
emtended to a length at least equivalent to the syndrome length of 
the maximum length bursts under consideration. For the example 
Channel. It Is assumed that no burst of length 6 block. (12 bits) or 
longer should exist or at least the chances of encountering such 
hursts are extremely slim. Based upon this assumption. It la evident 
that the maximum length syndrome patterns are limited to 12 bits. 

This means syndrome sequence for a 12 bit span must be examined before 
one can be certain whether it Is a short burst or otherwise. The 
reason is very slmple-the syndrome pattern of a short burst can be 
the prefix of the syndrom pattern of some long bursts and until the 
entire length of the pattern has been examined no assertion, can be 

made concerning the length of the burst. 

. fhp "svndrome detecting logic" 

Because of the above reasoning, the synor 

, d Si The shift register is 

has been revised to that shown in Fig. 5.3. 



Wjtput aaaoclated 

with col, 11 of 


Figure 5.3 Syndrone Detecting Logic 
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extended to 12 etaeee with one eddltlonel etege which will he 
explained later. Furthenwre, because sooe syndrome patterns of the 
long bursts have 8 consecutive terns . there can be no certainty 
that a burst la over by observing 7 consecutive teros. Since the 
shortest syndrome of tsa short bursts has 4 bits, the syndrome de- 
tecting logic must be implemented in aucli a way that this syndrome 
is detected before gat. 3 la turned on. This requires that at least 


9 consecutive taros must have entered the shift register before gets 
3 can be turned on; otherwise, this shortest burst will always be 
interpreted as "a long burst 1. over" for some time, and then behave 
unpredlctsbly tor the next 36 operations. In order to avoid exces- 
sive delays after a long burst la over, the S stage Is odd 
limit the delay to the least possible. Of course the whole design 
is based on the aasumptlor. that no burst longer than 12 bits should 
ever occur. If. In fact. channel encounters a burst of L blocks 
longer than 6 blocks, the detecting logic will direct the decoding 
action to the algebraic decoder L bits too early and this will result 
in L bits data loss: however, this Is not a disastrous situation. 


.Since bursts longer than 6 blocks w 
Vitorbi decoder also, but with the 
The beauty of this logic circuit is 


til be decoded l»i error by the 


following 72 bit delay as well, 
that it can catch the ending of 


most long bursts within 4 operations with only 


a few exceptions, 


these 


being the bureta whose syndromes have excessive delays. However. In 
no case will the delay bo laager than 9 opetstlons. and for an over- 


Whelming majority of the bursts. 


the ending can be indicated exactly. 


these sr. the longest hurst, anticipated, i.e. hut.ts of 6 block, 
though they are not supposed to occur frequently. 
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Furth«ir glwipliflc'atlon coi«bln«tU>« wf nyndroww pjittenw 
of short bursts msy bs possible by the '’Ksvusujjh nu»p" or "prime 
csnt table’* method, but In practice this Is hlRhly unlikely. The 
syndrome patterns of the short bursts consist of vwly a ve»*y small 
portion of the total p«vistble syndnsne patients and In general they 
aw widely scattei'ed in the "Karnaviph map", l.e. the chance of two 
syndrome pattews of the short bursts belnp adjacent is extre«»ly 
snutU. For the examj'le code, only the syndrvmws of event F and 
event F can be confined with the elimination of one variable. 

The rest of the syndrome detecting U^ptc is a direct translation 
of the vert>al specification into Vopic expressions. This will he 
self-evident after a detailed expVanattv»n of the functioning of the 
logic circuits 


In the nv^rmal situation, the channel is supposed to he clean and 
no action shall he taken hy the tJ.lKh.j the output of pale I Is al- 
ways "0", which «H'ans the decoding duty Is assunsnl hv the Vlterhl 
decoder, however, In cass of any error event, a "I" will enter the 
shift replster stapes wtlhln U operations from the occurence of the 
event. As soon as the "I" enters the shltt replster. pate will he 
actuated and the S.IU.. Is lu a sta.ul-hy position. Should the event 
he a random onor or a short hurst, pate will he reset to Its 

orlplnal state as soon as the first "l" In tl»e syndrome reaches 
and the alert Is wleaseh. U the event Is not a random error or 
short hnrsl, pate 2 will Slav in the "set" position until the first 
"I" in the svndrons' reaches S'* , l.e. a 1.' Ml deUav since the I Its I 
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•pp««ranc* of the notutro tyndromo bit, or 9 conaecuttvo aoroa hav« 
antarod cha ahlft raglatar, whichavar happana firat. And conditioned 
on tha fact that gata 2 la atill in tha '*aat" poaltion, l.a. tha 
avant la not a random error or a short burst, than gata 3 will be 
actuatad. With both gate 2 and gata 3 In the "aet‘* position, gata 1 
will produce a "1” output which means the decoding action shall be 
shifted to tha algebraic decoder. As soon as the decoding duty Is 
assumed by tha algebraic decoder, a counter starts to count. At the 
end of a 36 count, both gates 2 and 3 will be turned off and the S.D.L. 
returned to Its normal state. However, If the channel encounters 
anochar error prior to the ending of the 36 counts, the decoding will 
also be returned to the Vlterbi decoder, but the S.D.L. will remain 
In the "alert” mode. Should the second event be a random error or 
short burst, the S.D.L. will return to its normal state as usual; 
otherwise, the decoding duty will be assigned to the algebraic decoder 
after the burst Is over, in the same manner {is If this event were 
encountered for the first time. TJierefore, the S.D.L. switches the 
decoding actions back mid forth between the two decoders according 
to a set of predetermined decision rules. 

The only drawback of this algorithm is that when the channel 
encounters a short burst while the decoding Is In the algebraic mtide. 

It will never go back to the algebraic decoder after the burst la 
over, even If the Viterbl decoder Is not -.'.ynchronleed, l.e. tl»e 

counter has not finished the 36 counts, this problem can be clr- 
aunv'jnted by an "AND" at tl>e output of S.S.L. with the complement of 
the counter's output so that If the counter Is In the counting mode, 
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gate 2 cannot ba raaat, l.a. gate 2 can ba tumad off if, and only 
lf» tha eouncar la not In tha counting mode. Furtharmora, tha feed- 
back connection bataaan tha output end of gate 5 and tha counter 
shall ba raaovadi which neana that once the counter atarte counting, 
nothing can teradnate it until it finiahea the 36 counta. Tliia 
alternative impleoentation alao haa ita abort cominga. It regards all 
the short burata which occur when the counter is in the counting n»de 
as long bursts and re-initiates the coui\ter with each new occurrence 
of a burstt If the channel is rich in random errors or short bursts, 
the decoding will return to the Viterbi decoder momentarily and stay 
with algebraic decoder the rest of the time. Methods must be incorpo- 
rated so that the counter can be initiated only when the burst is 
long. This can be done by conditioning the gate I's output with the 
S..S.L. output before sending to the "SET" termln.il of the counter, so 
that the counter cannot be re-lnitlated vmless the S.S.L. output Is 
"0", l.e. the event Is a long burst. With such modifications, evety 
time the hybrid decoder encoimters a long bui\st, the next 36 vlecoded 
bits are regarded as vwreiiable reg.irdless of whether the occurrence 
is within the 36 bits span or not; luiwever, the occurrence of random 
errors or short hursts will not lultl.nte the counter, even If the 
hybrid system is In tiro counting mode; the only action tlrat the system 
takes is Co return tire decodltrg to the Viteibl decoder for as long as 
the emrr ev’ent lasts. For the iotails of this modified S.D.l.., please 
see Fig. 5.4. 

Since during tire courrting period the Viterl'l decoder's outputs 
are not reliable, tenrporarlly I’oturrrlrrg the decoding operations to 


; ^ Coimect to 
^ gate A throughL 
see Fig. 5.6 



rrL_a_r I U/iiT^ 

LU- 

-<tz 


or 3 


An inpulse will be sent 

V — L . — . 


out after 36 counts r - 


Kalntaina a algnal 
level ••r*. If not 
in the counting node 


An iag>ulse vill initiate 
a counting process* starts 
fron 1, reset to 0 after 
36 counts. 


Algebraic decoder 'a output _j 
associated with Col. 1C of 6^ 


Dote: If the channel encounters 

a second error while the hybrid decoder 

is in the counting mode, decoding will 

be returned to the Vlterbl decoder 

Cenporarily. then goes back to the Figure 5.4 


Syndrome Detecting I#ogic 


Algebraic decoder's output^j^ 
associated with Col. 11 of 


counts. If the second error is a 

long burst, starts counting fromrero again. 
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thU d«cod«t dMi not gunrnntoo ortor troo ronnltn. 'n>la I**''* 

to th. ooo,ld.r.tlon ot . third ..notion. It 1. kn-n. th.t th. 
.l».hr.lo d.ood.r 1. not Jn.t . .yndron. ct.«tor, but o.n .1.0 ..rM 
.. . wltlpU p.tlty oh.ok docodn for oonwlntlon.l cod... th. 
only ronulnnont 1. th.t d - o hlook. ot orror fro. ««.r.. .n.o. 

.n.t b. pm,ld.d. Ihl. 1. trn. In «.n.r,l .Uh «ry high prob.blll.y 
If rondo, orror. .r, th, o..o. »nd.r th. condition th.t th. ch«.n.l 
1. lnd..d ,0 h.novol.nt. th. .Igobr.lc doctor «y ho n«d to corroct 
,11 orror, .h.n th. Vltotbl docnter 1. ont o. .,nchr.™U.t l«n. Th. 
.lg.hr.lc docodor 1. c.,,-.V. of corroctln, .11 orror p.tt.m, th.t 
.ro llnltod to .Ithln 1 block., l.o. d Mt., .hlch I, cctly Iho .... 
„ th,t ot tho Vltotl-l docodor for ,horl block.. ThoorotlcUy. th. 
orror correcting potontul ot the .Igobr.lc docodor 1. ng to bnr,u 
of b block, long, hot tho co.plo.lty of tho h,rd..ro or tho 
storogo togulred forbid. ,och l.g.lo»ont.tloo. Swn It tho oitot 
correcting of tho .tgobr.tc docodor I, It.ltod to r.n.lot» error, tntd 
.nort bnt«,. tho third v.rt.tt.n. vonld ,»rtom .uch bettor th«. tho 

Cirot two If the chnnnol 1. known to glvo ono.nth ottot It* g 
,p,c. The cholco I, .ctn.Uy .topondont . not n,g.n tho ovor.ll orror 
r .,0 bnt up.» tho ch,nnol ch.r.ctorl.t tc th.t 1. whothor tho chonn. 1 
b„. «.ro r,,n.lo. orror. or bnr.tv orror,. or whothor tho cb,nnol orror 
«.„t, .ro ,p.r.o enough to provt.to clcrn gn.rd ,p.co. the S.lt.... 
for thi, ..notion t» «h.~t. in fig. I.' »nd Hg, h.b. 


Tiro hvbrld decoding pro.o„ .toeolopod. togothor with tho Vltorbt 
.nd .Igehraic .locdoc. ... .Innl.tod on . t'nio.c lH't> to votltr H. 







S.S.L. Inputs Connection Table 


^|^"AND" gate shown Is a typical gatert»»t feeds 
into the "OR" gate labelled as . The 

inputs of the "AND" gate are connected to the 
shift register stages s , 1 - 1,2,... 12. 

Whether these output, shall be couple-anted or 
not before feeding into the corresponding "AND" 
gate, please see the "S.S.L. Input. Connection 

- Table". If the corresponding entry in the table 

- 3 do not co^le-ent it. If a * 0 , co-ple-e 

J it, if a ie shown, which -eans "don't care , 
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error correcting capability and to compare the performances of the 
three. Details of the sionilatlon are given in the Appendix. Random 
information was encoded using the (2,1), constraint length 7 convo- 
lutional code. 

Twenty-three complex channels were simulated and 2000 words, or 
64000 bits, were used for each test run. For each channel the nominal 
error rate was made IX, O.IX and O.OIX. Channels were characterized 
by both random errors and bursts with burst lengths ranging from 1 
block to 6 blocks. The 23 channels ranged from channels with OX 
random errors, i.e. pure bursty channels to channels with lOOX random 
errors, with an increment of 5X random errors for each successive 
simulation. The frequency of bursty events was always made Inversely 
proportional to the burst lengths. Whenever a burst was simulated, a 
random number truncated to the appropriate length was inserted to the 
error sequence; however, for a random error only the corresponding 
received bit was inverted. The two additional channels simulated were 
the channel with strictly short bursts and the channel with strictly 
long bursts. 

A syndrome table consisting of all the syndrome patterns for 
short bursts was stored so that the decoding of short bursts could be 
made definite. Long bursts were decoded according to the standard 
method discussed earlier, that is, identifying the correct decoding 
operation and using the outputs of that operation to replace all the 
previously decoded b.ts. Thus, a finite chance of erroneous decoding 
is possible. 

A buffer register of length equivalent to the decoder’s con- 
straint length of the Vlterbi decoder was used to temporarily hold 
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the algebraic decoder's output; the function of this buffer is two- 
fold, first, for holding the algebraic decoder's outputs for later 
retrieval and possible corrections, second, for synchronisation with 
the Viterbi decoder's output. After an initial DCL bits delay, the 
syndrome detecting logic commanded the system to accept one of the 
sub-decoder's output according to a bookkeeping register's content— 
if "1" was Indicated, using the algebraic decoder's output, otherwise 

using Viterbi* 8 output. 

Parameters monitored were error counts and error probabilities 
for each type of error event and in addition, the number of errors 
per word; each word was regarded as 32 bits for the code tested. All 
were recorded before decoding and after decoding and for all three 
decoders. Finally, an overall performance measure was calculated in 
terms of both e-ror reduction and error ratio. 

5.4 Experimental Results and Findings 

Table 5.2 summarizes the results of all the 23 simulations. It 
can be easily seen that the hybrid decoder out-performed both the 
Viterbi decoder and the algebraic decoder in every case. Fhe only 
exception was that for the 1% random error channel, the hybrid 
decoder had one decoding error while the Viterbi decoder corrected 
all the errors. This could be an accident, h'Owever, it is also 
anticipated that while the hybrid decoder is the best decoder for 
compound channels, its performance can only approach that of the 
Viterbi decoder in strict memory less channels, but can never exceed 

it. 
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TABLE 5. 2 
(Continued) 

a»fPARISON OF CHANNEL PERFORMANCE FOR DIFFERENT CODING SCHEMES 
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TABLE 5. 2 
(Continued) 

COMPARISON OF CHANNEL PERFORMANCE FOR DIFFERENT CODING SCHEMES 
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TABLE 5. 2 
(Continued) 

COMPARISON OP OlANNEL PERFORMANCE FOR DIFFERENT CODIHC SCHEMES 
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ALGEBRAIC 

HYBRID 

RATIO OF IMPROVEMENT 

4911 

1225 

1183 

732 

0.498880 

0.481776 

0.298106 

0,597551 

643 

72 

87 

43 

0.223950 

0.270607 

0.133748 

0.597223 

31 

1 

2 

1 

0.064516 

0.129032 

0.064516 
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errors were treated as short bursts. This may not be a hazard if the 
random errors are sparsely distributed. However, if the successive 
random errors are not separated by enough clean guard space, it will 
be mistaken as a long burst and allocated to the algebraic decoder. 
Clearly, the algebraic decoder may commit more mistakes than the 
Vlterbl decoder for such "pseudo-bursts", and thus become a source of 
deterioration for the hybrid decoder. However, this deterioration 
would not happen if the syndrome detecting logic could correctly 
Identify the beginning and the ending of an error event. Therefore, 
the first drawback seems the most serious one. 

Another factor which has a decisive influence on the performance 
of the hybrid decoder is the number of consecutive zeros in the syn- 
drome patterns. If the maximum number of consecutive zeros over all 
syndrome patterns were small, the decision of the event "error is 
over" could be made much earlier, then the guard space requirement 
could be significantly relaxed, and many long bursts could be broken 
up Into several short bursts. If this were true, the overall per- 
formance of the hybrid decoder would also be Improved. 

So far all the drawbacks of the proposed hybrid decoder have 
been mentioned. These drawbacks are difficult to remove. First, 
it is not possible to store all the syndrome patterns because of 
storage space and the searching time Involved. Second, the nuoiier of 
syndrome patterns are in the same order as the number of error patterns 
and are of the same length. For distinct syndrome patterns to exist, 
about 3/4 of the n-tuples In the n-space must be selected. This will 
not allow all the syndrome patterns to have a "1" in the first position 
and a "1" in the last position, and the all-zero blocks within all 


P*^^**^* will b« very short. Unless some other approsch is takeni 
no drastic improvements can be seen. 

The proposed hybrid decoder, though it has these drawbacks, is 
in performance still superior to any known algorithms for the com- 
pound channel. This is because that the chances of encountering a 
"bad" syndrome pattern are low and the "bad" syndrome pattern causing 
an erroneous decoding is still lower. Even for arbitrarily long 
bursts, the algorithm allows the decoding errors committed by the 
algebraic decoder to be limited to within (r -)• bits and the rest 
of the sequence is passed to the Vlterbi decoder. Furthermore, the 
error propagation effect of the Vlterbi decoder is also suppressed. 
Error propagation uppression can be achieved for any error event, 
regardless of whether it can be corrected by the algebraic decoder or 
not; therefore, this Is the biggest advantage of the hybrid decoder 
and one of the factors that is responsible for the overall improve- 
ment of the algorithm. 

Based on the above observation, it seer.« that the proposed 
algorithm works best when the channel Is rich In short bursts and 
worse when the channel is strictly random and the random errors are 
not separated by enougli clean guard spaces. Since purely random 
events, by definition, must be distributed evenly over their sam)>le 
space and not tend to cluster together, for channels with reasonable 
error density clean guard spaces should bo achieved. Tlierefore, It 
Is those "nearly random and nearly bursty errors" that cause troubles. 
Just where the dividing line is between "a group of random erroir" 
and "one long burst" la not quite clear. Hie correct deflnln% of the 
two kinds of errors may have to depend on a better imderstandlng of 
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CHAPTER VI 


RECOMMENDATIONS 


6.1 The Goal 

Theoretical formulation indicated that the rate 1/2, constraint 
length 7 code used for simulation should be an optimal B2 burst 
corrector. Its random error correcting capability is well-known to 
be very good— actually the best code that has ever been used in 
practical applications. This code is capable of correcting 6 con- 
secutive blocks of errors in a 12 block span; that is, even if half 
of the received sequence is in error, no information has been lost as 
long as the erroneous bit streams are separated by clean guard spaces 
of 6 blocks or longer. For error events that are not followed by these 
clean guard spaces, the information content is still recoverable if 
they are randomly distributed with a short length of 1 to 2 blocks as 
these are deemed correctable by the Vlterbl decoder from an earlier 
study. The goal Is to find a decoding algorithm which can fully 
exploit the potential burst-correcting capability of the code and yet 
perform as well as the Vlterbl decoder In dealing with the random 
errors. 

6.2 Problems and Possible Approaches of Attacking 

These Problems 

As mentioned In Sec. 5. 5, the proposed algorithm performs well 
for compound channels but It has not reached the full error correcting 
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potential of the code. Several inmedlate problems encountered 

during the reelltetlon of the proposed hybrid olgorith. were also 

pointed out in that .action. Here it is weU to reconsider these 
problems : 

1. The syndrome patterns do not always begin with a "1" and 
end with a "1". The damages caused by this fact might not 
be when the errors are segmented by long clean guard spaces 
but rather when two consecutive bursts, the syndrome of one 
prefixed with several zeros and the other suffixed with 
several zeros, are so close that the zeros of both syndromes 
are overlapping. Since the chances of such events are very 
low, they may not be a serious problem. One possible solu- 
tion might be the use of "s3mdrome removal" instead of 
"syndrome resetting". After each decoding operation, 
methods may be used to calculate the syndrome of the assumed 
error vector and subtract it from the content of the syn- 
drome register. If the assumption made Is correct, the 
syndrome register will be zero; otherwise, the correction is 
improper and it should be attempted again at the next opera- 
tion. It would be even better if methods could be devised 
to extract information about the error vector from the 
remainder of the syndrome register after each syndrome 
removal. Another approach is to re-encode the decoded 
sequence. If both sequences are in perfect agreement, it 
may be assumed that the received sequence is error free and 
this fact may be used to check the clean guard space require- 
ment. However, the above statement is only a necessary 
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sacrificed. If the channel error distribution is such that 
the error events are sparse, the above-mentioned method will 
not cause significant deterioration, otherwise extra caution 
must be excercised. One empirical solution is to perform 
experiments, using various ’'aero-check" lengths, to deter- 
mine which one gives the best performance. 

3. The syndrome detecting logic used for the proposed hybrid 

decoder can only differentiate short bursts from long bursts. 
Random errors may be treated as either short bursts or long 
bursts, depending on when the error sequence obtained the 
required clean guard space. If a group of random errors is 
treated as a short burst, no problem will result. However, 
if it is treated as a long burst, the nonde finite decoding of 
long bursts by the algebraic decoder and the excellent 
random-error-correcting capability of the Viterbi decoder 
would, on the average, cause deterioration. Just what could 
be done for this problem is not quite clear at the moment. 
This is true because little is known about the Viterbi 
decoder's performance with respect to the density of error 
bits in the received sequence. 

It is felt that full Information content of a contiiml- 
nated sequence must be extractable if the "complexity of 
hardwares" is disregarded. rrol)ably a completely different 
approach should be taken In the forming of syndrome patterns 
and the designing of syndrome search logic. It is also 
possible that the proposed algorithm Is the optimal within 
reallxability. Much is left to he determined by future 
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APPENDIX 


SIMUUTI(»l 


As pointed out in Sec. 5,2.3. there are many different ways of 
interfacing the two algorithms and each has its advantages and dis- 
advantages. It was found during actual computer simulations that the 
last variation, with some additional modifications, worked the best 
among others. Simulations were performed on Univac 1108 multipro- 
cessor. The final procedure adapted was to let the algebraic decoder 
correct all the bursts, long and short. Random errors were treated 
as short bursts if they were followed by enough clean guard space; 
otherwise, they were passed to the Viterbi decoder to be decoded 
probabilistically. This is because the algebraic decoder can correct 

short bursts definitely while the Viterbi decoder can only decode 
probabilistically. 

Both source data and chr.nnel statistics were created by using the 
pseudo-random numbers. The general process was to create source words 
each consisting of 32 bits, encoding these words, adding channel error, 
in a fashion consistent with specified channel statistics, and then 
decoding the received sequences using differing algorithms. Parameters 
were monitored which allowed calculation of probability of bit error 
rates for both coded and uncoded systems. Fig. A. 3 is a sample of the 
output format which shows the type of data monitored, collected, and 
tabulated. Table A.l lists the input parameters that have to be 


specified. 


fRigSOWQ fAGfe-BLAJait 

The computer program developed allows the simulation of any 
rate 1/n code, as long as the constraint length of the encoder is less 
than 32 stages; however, some minor adjustments mtwt be made if n 2 
and the generator matrix is not of size 12 x 12. 
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APPENDIX A 
ENCODER 

Encoding is perfonaed sequentially in strict accordance with 
the diagrams shown in Fig. 2.4 or Fig. 4.4. Each encoding operation 
causes one bit of the source sequence entering the shift register. 

Then the contents of the corresponding stages are «od-2 added accord- 
ing to the connection vectors. After the outputs of these EXaUSIVE 
ORs were transferred to the codeword register, the contents of the 
shift register were shifted sequentially one place to the right, 
the shift register was ready to receive the next input bit. 

The source words were generated from a set of uniformly dis- 
tributed pseudo-random numbers by referring to the seed number. The 
seed number was changed every time when a new set was request u -.o 
prevent repetitious data. Since convolutional codes are linear codes, 
the decoder’s performance should be invariant to any message sent. 

This implies that an all zero sequence could be used to test the 
decoder’s capability. Reasons for using pseudo-random numbers as 
test data are (1) to detect any non-linearities which might occur in 
the hybrid decoding algorithm and (2) for aesthetics. 
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appendix b 

CHANNEL 

Channels of various statistics can be simulated by proper 
choice of the channel parameters. Determination of an error event 
is accomplished by examining a sequence of pseudo-random numbers 
uniformly distributed between 0 and 1 . since the probability of 
observing a number lying between a certain interval is simply the 
length of that interval, error events of various probabilities can 
be created by assigning proper length of intervals to each of them. 
For instances, if a 30% channel is desired; among the 30% errors, 15% 
are burst errors and among the burst errors, 10% are short bursts 
and 5% are long bursts, then the assignment is shown as follows: 



long burst 

Fig A.l Probability distribution function of the 
pseudo-fandora numbers. 
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APPENDIX C 
VITERBI DECODER 

The Vlterbl algorithm used In the program Is exactly as de- 
scribed in Sec. 3.2.1. 

First » a decoding table is constructed and stored. This table 
contains all the information of the trellis diagram; it provides 
output data for all possible states with all possible input combi- 
nations . 

For each decoding operation^ one received block is fetched from 

the received word register. Since there are 2 paths leading to 

each node of the trellis, the outcomes of these paths are compared 

with the received block to determine which one is the most likely 

path; this has to be done for all nodes. The path that causes the 

least number of errors is selected for each state and the number of 

errors caused is recognized as the score of tliat state. At the same 

time, the corresponding input bit is stored in the survivor sequence 

£ 

register. The following decoding steps compare the 2 paths lead- 
ing to the same node, but the selection of the optimal path is based 
one the accumulated score of the previous operations and the current 
operation. Otherwise, the procedures are the same. The lengths of 
the survivor registers are made equivalent to the decoder’s con- 
straint length. Since the contents of these registers are shifted 
to the right one place after ead. operation, outputs start dumping 
out after DCL operations. Furtherr*ora, all the survivor paths will 
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Atomic DECOm AED SYNDEOME DETECTIHG UJOIC 

Algebraic decoding is achieved by posmultipUc.tion ot the 
„«lved se, nance nith the inverse oi the generator natrir. i.e. 
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the length of the error vector are known precisely end the decoding 
is definite. Since the nonzero interval of the syndrome patterns of 
the short burst varies from 5 to 8, the entire decoded sequences of 
12 bits resulting from these steps of the operation are subscripted 
and stored for later retrieval. 

Long bursts are those bursts which cannot be found in the SYDSRH 
table. The decoding of the long bursts depends on the examination of 
a certain number of consecutive zeros, designated as ZCK, in the 
syndrome sequence. If this criterion is satisfied, starting from the 
operation right ahead of the appearance of the first "0" , counting 
back, 12 temporary decoded bits are replaced by the entire decoded 
sequence of that operation. It seems that the content of XA2 of 
every step has to be saved; however, this is not necessary. All that 
has to be done is to transfer the content of XA2 to a temporary regis- 
ter XAIT at each step when the corresponding syndrome bit is not "0"; 
otherwise, no action shall be taken. 

GIK register is used to keep track of the decoding actions of 
the algebraic decoder for the hybrid decoder's information. If an 
error event has been corrected by the decoder, a "1" is recorded in 
the corresponding position; othen^ise the filling of a "0" or a "1" 
depends on whether that step of the operation for the corresponding 
liybrid system should be in mode 1 or mode 2, where mode 1 designates 
the Viterbi mode and mode 2, the algebraic mode. 

Since an erroneous decoding of the Viterbi decoder may cause the 
outputs of the next 3b operations, i.e. 72 received bits, to be un- 
reliable, during this period, the only useful results are those 
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coming from the algebraic decoder. Therefore, a counter CTR Is 
employed to keep track of the out-of-synchronlzatlon period of the 
Vlterbl decoder. If a long burst Is detected, l.e. when the search 
of SYDSRH falls, as soon as the burst Is over, CTR starts to count 
from 1, 2, ... up to 36, one Increment after each decoding step; then 
It Is reset to zero, waiting for the next Initiation. During the 
counting period the hybrid system Is regarded as In mode 2. Whenever 
the channel Is clean, the corresponding bit position of the 61R 
register Is assigned a "0", If the system Is Ir mode 1; otherwise, 

"1" Is assigned. Another function of the mode register is to remind 
the hybrid system to keep on counting, even If decoding Is temporari- 
ly returned to the Vlterbl decoder for some hybrid schemes, or for 
this particular scheme, when a short burst Is encountered while in 
mode 2. 

Since most times the error vectors are not as long as 12 bits. 

It is desirable to truncate the decoded vector in XAIT to proper 
length before transfer and replacement; SYCC and ZCS counters are 
used for this purpose. SYCC tells the beginning and ZCS, the length 


of the replacement. 
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Card 1 

NW ~ number of possible words 

NBPSW - number of bits per source word 

N - number of bits per source block 

K - number of EXCLUSIVE ORs 

CL - encoder constraint length 

DCL “ decoder constraint length 

CDS “ guard space to be inserted in the channel, could be entered 
as zero. 

ZCK - number of zeros in the syndrome sequence to be examined before 
making the decoding decision for long bursts. 

ASEED - the initial seed number to be assigned to induce a sequence of 
pseudo«*random numbers, it could be any real number. 

Card 2,3 

PBL and BL - BL denote the various error events and PBL are their 
corresponding probability assignments. They are sub- 
scribed variables; a total of 12 varieties can be accom- 
modated; however, only minor changes of the program are 
required to increase this capacity. 

Card 4 

HKl and HK2 - the connection vectors of the encoder, represented in 

octal numbers. Can be increased if the number of EXCLUSIVE 
ORs of the encouer Is more than 2, 

Card 5,6 

G (I) - row vectors of the generator matrix, represented In octal num- 

ber* G (I) is not used unless algebraic encoding is intended, 
G1(I) - row vectors of the Inverse of the generator matrix, repre- 

sented in octal number 

If the generator matrix is other than 12 rows, minor adjustment must 
be made in the program. 

TABLE A.l Input parameters of the simulation program 
-hybrid system. 
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